-- Logs begin at Sat 2022-09-03 00:41:58 UTC, end at Sat 2022-09-03 01:38:14 UTC. -- Sep 03 01:08:18.292883 dv-cinder-838009-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 03 01:08:18.300462 dv-cinder-838009-7-smb devstack@keystone.service[81462]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 3 01:08:18 2022] *** Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: nodename: dv-cinder-838009-7-smb Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: machine: x86_64 Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: clock source: unix Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: pcre jit disabled Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: detected number of CPU cores: 4 Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: current working directory: / Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: detected binary path: /usr/bin/uwsgi-core Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: your processes number limit is 47680 Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: your memory page size is 4096 bytes Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: detected max file descriptor number: 2048 Sep 03 01:08:18.302468 dv-cinder-838009-7-smb devstack@keystone.service[81462]: lock engine: pthread robust mutexes Sep 03 01:08:18.303214 dv-cinder-838009-7-smb devstack@keystone.service[81462]: thunder lock: enabled Sep 03 01:08:18.303214 dv-cinder-838009-7-smb devstack@keystone.service[81462]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 03 01:08:18.303214 dv-cinder-838009-7-smb devstack@keystone.service[81462]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 03 01:08:18.342186 dv-cinder-838009-7-smb devstack@keystone.service[81462]: Python main interpreter initialized at 0x56397c98d9c0 Sep 03 01:08:18.342186 dv-cinder-838009-7-smb devstack@keystone.service[81462]: python threads support enabled Sep 03 01:08:18.342186 dv-cinder-838009-7-smb devstack@keystone.service[81462]: your server socket listen backlog is limited to 100 connections Sep 03 01:08:18.342186 dv-cinder-838009-7-smb devstack@keystone.service[81462]: your mercy for graceful operations on workers is 90 seconds Sep 03 01:08:18.342585 dv-cinder-838009-7-smb devstack@keystone.service[81462]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 01:08:18.342661 dv-cinder-838009-7-smb devstack@keystone.service[81462]: *** Operational MODE: preforking *** Sep 03 01:08:18.342920 dv-cinder-838009-7-smb devstack@keystone.service[81462]: *** uWSGI is running in multiple interpreter mode *** Sep 03 01:08:18.342920 dv-cinder-838009-7-smb devstack@keystone.service[81462]: spawned uWSGI master process (pid: 81462) Sep 03 01:08:18.343169 dv-cinder-838009-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 03 01:08:18.344014 dv-cinder-838009-7-smb devstack@keystone.service[81462]: spawned uWSGI worker 1 (pid: 81480, cores: 1) Sep 03 01:08:18.344314 dv-cinder-838009-7-smb devstack@keystone.service[81462]: spawned uWSGI worker 2 (pid: 81481, cores: 1) Sep 03 01:08:18.347284 dv-cinder-838009-7-smb devstack@keystone.service[81462]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 01:08:22.603943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:08:22.603943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: from cryptography.utils import int_from_bytes Sep 03 01:08:22.604763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:08:22.604763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: from cryptography.utils import int_from_bytes Sep 03 01:08:22.604874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:08:22.604874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: from cryptography.utils import int_from_bytes Sep 03 01:08:22.605604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:08:22.605604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: from cryptography.utils import int_from_bytes Sep 03 01:08:22.655304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 01:08:22.655539 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 01:08:22.655700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 01:08:22.655850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] command line args: [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 01:08:22.655933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 01:08:22.656019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 01:08:22.656094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] command line args: [] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 01:08:22.656173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ================================================================================ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 01:08:22.656341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 01:08:22.656468 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] admin_token = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.656542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ================================================================================ {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 01:08:22.656621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_dir = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.656731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] admin_token = **** {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.656869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.656947 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_source = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.657028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] config_dir = [] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.657103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] debug = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.657193 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.657268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.657583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] config_source = [] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.657583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] debug = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.657694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.657760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.657849 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.658124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.658209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.658347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.658432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.658604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.658887 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.658999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.659064 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_config_append = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.659129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] list_limit = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.659198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.659282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] log_config_append = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.659483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_dir = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.659563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.659630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.659688 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] log_dir = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.659845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] log_file = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.659937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.660017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.660092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.660254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.660342 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.660502 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.660590 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.660659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.660781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.660859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.660930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.661071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.661207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.661428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.661555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.661555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.661715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.661788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.661857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.661989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.662101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.662219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.662311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.662465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.662562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.662700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.662778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.662949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.663045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.663225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.663500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.663680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] publish_errors = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.663768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.663910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] publish_errors = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.663987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.664142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.664270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.664363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.664436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.664596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.664758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.664758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.664978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.665078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] standard_threads = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.665151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.665222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.665301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] standard_threads = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.665441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.665525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.665617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.665693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.665793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_journal = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.665934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.666018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_json = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.666088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] use_journal = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.666156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_stderr = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.666224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] use_json = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.666293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_syslog = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.666371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] use_stderr = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.666492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] use_syslog = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.666566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.666723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:08:22.666798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.666975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.667066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.667213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.667303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.667489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.667609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.667739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.667823 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.667973 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.668047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.668215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.668296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.668449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.668531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.668689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.668770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.668934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.669008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.669180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.669265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.669411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.669492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.669651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.669726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.669884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.669971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.670121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.670237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.670365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.670441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.670601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.670686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.670835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.670909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.671093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.671169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.671361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.671445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.671598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.671681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.671843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.671923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.672096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.672180 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.672349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.672486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.672600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.672683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.672831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.672909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.673062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.673138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.673291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.673373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.673630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.673753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.673841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.674037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.674117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.674295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.674386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.674527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.674604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.674757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.674837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.675002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.675084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.675291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.675370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.675507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.675583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.675756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.675839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.675986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.676060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.676221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.676294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.676456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.676540 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.676685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.676760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.676915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.676989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.677143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.677290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.677363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.677430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.677593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.677669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.677842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.677925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.678071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.678145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.678307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.678380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.678536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.678623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.678769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.678844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.679000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.679073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.679246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.679349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.679498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.679572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.679732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.679805 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.679964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.680039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.680199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.680274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.680432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.680545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.680650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.680750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.680880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.680988 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.681127 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.681241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.681344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.681437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.681582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.681699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.681810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.681894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.682066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.682154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.682299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.682375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.682529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.682603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.682762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.682839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.682998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.683077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.683279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.683360 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.683521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.683601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.683769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.683854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.684010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.684092 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.684245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.684320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.684480 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.684557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.684713 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.684789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.684960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.685044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.685194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.685271 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.685429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.685508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.685671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.685745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.685903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.685982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.686151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.686227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.686384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.686460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.686619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.686702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.686854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.686928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.687089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.687181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.687349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.687455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.687609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.687691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.687850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.687935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.688099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.688177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.688340 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.688429 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.688584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.688662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.688818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.688891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.689035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.689114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.689303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.689441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.689573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.689716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.689847 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.689952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.690028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.690100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.690194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.690283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.690424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.690508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.690653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.690730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.690893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.690978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.691127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.691215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.691396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.691475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.691632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.691722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.691887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.691964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.692144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.692221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.692386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.692495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.692618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] auth.external = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.692705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.external = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.692846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.692930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.693141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.693220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.693374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.693459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.693605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.password = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.693681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] auth.password = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.693836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] auth.token = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.693912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.token = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.694074 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.694161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.694308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.694386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.694555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.694632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.694783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.694867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.695029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.695114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.695291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.695375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.695524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.695614 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.695757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] credential.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.695834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.696001 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.696099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.696251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.696425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.696504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.696619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.696729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.696808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.696973 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.697058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.697206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.697285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.697452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.697529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.697705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.697790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.697942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.698019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.698194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.698271 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.698479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.698563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.698728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.698806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.698986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.699062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.699226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.699355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.699506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.699582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.699745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] federation.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.699840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.699980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.700059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.700225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.700302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.700470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.700554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.700701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.700779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.700947 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.701024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.701183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.701260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.701437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.701516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.701670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.701748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.701925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.702003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.702159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.702243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.702405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.702482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.702638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.702715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.702886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.702965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.703131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.703217 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.703388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.703467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.703624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.703704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.703867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.703944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.704100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.704178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.704335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.704420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.704584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.704667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.704881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.705086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.705215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.705351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.705483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.705612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.705693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.705765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.705845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.706010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.706090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.706254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.706340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.706501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.706587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.706745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.706822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.706995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.707072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.707238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.707350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.707493 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.707572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.707723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.707800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.707961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.708046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.708187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.708265 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.708417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.708494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.708653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.708739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.708889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.708967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.709124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.709201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.709358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.709435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.709595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.709678 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.709837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.709914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.710070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.710150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.710303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.710380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.710546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.710623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.710775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.710854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.711007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.711084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.711235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.711353 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.711488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.711568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.711722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.711808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.711955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.712032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.712191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.712268 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.712426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.712502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.712661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.712740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.712910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.713022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.713160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.713258 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.713391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.713493 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.713624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.713746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.713995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.714079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.714237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.714324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.714472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.714553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.714709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.714787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.714941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.715018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.715173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.715300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.715442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.715521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.715675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.715752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.715925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.716011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.716173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.716249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.716424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.716502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.716674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.716753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.716903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.716980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.717136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.717250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.717371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.717449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.717608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.717685 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.717844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.717921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.718073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.718151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.718321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.718398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.718564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.718640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.718810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.718890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.719054 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.719131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.719305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.719392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.719548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.719627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.719782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.719860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.720484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.720689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.720689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.720951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721185 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721256 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721337 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721743 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.721832 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.722004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.722083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.722238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.722317 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.722473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.722563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.722708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.722785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.722948 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.723026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.723187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.723301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.723448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.723515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.724354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.724465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.724545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.724616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.724616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.724720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.724942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] resource.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725361 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725361 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.725872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.726051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.726116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.726213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.726292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.726462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.726539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.726696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.726777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] role.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.726945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.727023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] role.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.727190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.727319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.727461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.727540 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.727710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.727801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.727957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.728035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.728203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.728282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.728447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.728523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.728693 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.728770 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.728929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.729014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.729177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.729255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.729414 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.729491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.729662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.729740 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.730244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.730330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.730500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.730668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.730755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.730908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.731145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.731223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.731412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.731492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.731663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.731748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.731913 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.731990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.732146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.732231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.732402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.732479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.732639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.732717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.732878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.732964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.733111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.733190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.733348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.733427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.733580 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.733664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.733812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.733891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.734051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.734129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.734300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.734389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.734534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.734611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.734769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.734847 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.735000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.735086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.735234 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.735330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.735489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.735566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.735726 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] token.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.735816 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.735960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.736186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.736321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.736545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.736681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.736776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.736889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.737009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.737155 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.737257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.737414 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.737509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.737655 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.737734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.737901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.737981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.738148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.738235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.738402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.738480 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.738640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.738719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.738882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.738967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.739121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.739209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.739396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.739477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.739662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.739740 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.739896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.739983 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.740143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.740223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.740380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.740457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.740623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.740701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.connection = **** {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.740860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.740940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.741097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.741176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.741332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.741411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.741570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.741640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.741815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.741881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.742049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.742115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.742282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.742350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.742516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.742583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.742759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.742825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.742992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.743061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.743233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.743318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.743486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.743553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.743728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.743797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.744157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.744288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.744288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 01:08:22.744520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.744520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.744758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.744874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:08:22.745045 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 01:08:22.773991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.774302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.774394 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.774527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.774676 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.774801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.782902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.783670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.812079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.812378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.812516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.812516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.867936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.872035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.924173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.924485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.925553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:22.925758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.103275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.103569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.103707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.103921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.104080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.104169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.104279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.104371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.104644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.105268 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.105496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.105706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.132543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.132715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.132914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.133143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.133331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.133574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.133765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.133998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.134371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.134736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.135095 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.135468 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.135810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.136148 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.145551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.147455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.158905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.159158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.159340 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.159593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.159811 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.160038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.160247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.163563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.163882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.164030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.164283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.164470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.164704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.164918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 01:08:23.177699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.177925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 01:08:23.178228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.178439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 01:08:23.178718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.179019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.179212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.179387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 01:08:23.179494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.179494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.179694 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.179953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 01:08:23.180267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.180533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.181212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.181212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.192953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.193321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.193600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.193777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.193891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.194193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.194620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.195067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.200984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.204148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.204465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.204730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.205244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.205424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.205424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.205699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.205917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.206223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.206530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.206862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.207141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.208200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.208513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.208774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.209041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.209356 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.209641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.209901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.210177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.210451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.210727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.210996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.235549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.237410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.237765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.237966 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.239777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.240851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.243304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.243741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.244113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.247218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.247584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.247858 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.254659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.254953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.256380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.256781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.263750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.264003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.264202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.264339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.264474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.264666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.264796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.265049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.265194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.265323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.265548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.265682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.265841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.265980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.266343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.266625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.281985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.282277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.282388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.282673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.286505 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.286735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.289956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.290159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.290305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.290509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.294393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.294720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.297509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.297870 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.300903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.301180 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.301366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.301461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.301645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.301737 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.301861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.302069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.302164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.302296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.302465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.302672 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.318354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.318673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.318945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.319175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.321330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.321631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.321903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.322168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.326050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.327673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.329136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.329263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.329409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.331233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.332810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.333044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.333176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.333414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.333630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.333912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.334301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.335755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.336043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.336341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.336625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.337033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.345953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.346416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.346887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.347235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.347644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.347939 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.348225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.351228 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.351548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.351835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.352120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.352510 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.352791 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.353069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.364637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.367583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.369642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.370503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.372093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.373270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.374741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.375235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.375927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.376207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.378215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.379939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.380327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.380991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.384369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.386817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.388236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.389707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.391953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.392460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.392754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.392911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.393066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.393286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.393575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.393854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.400860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.401169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.401447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.401673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.402005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.402299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.408358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.408722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.409010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.409293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.409566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.409840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.410094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.410402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.410670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.410948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.411226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.411520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.411785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.412045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.412132 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 01:08:23.412366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.412650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.412932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.413190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.413473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.413763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.414036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.414307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.414604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.414878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.415143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.415453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.415717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 01:08:23.449135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56397c98d9c0 pid: 81481 (default app) Sep 03 01:08:23.452789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3178a-f5ca-463c-9fbf-a12c32254b3c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:23.453075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3178a-f5ca-463c-9fbf-a12c32254b3c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:23.453705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3178a-f5ca-463c-9fbf-a12c32254b3c None None] PATH_INFO: `/v3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:23.458011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Sat Sep 3 01:08:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:23.460663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56397c98d9c0 pid: 81480 (default app) Sep 03 01:08:30.206851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc3ee-b6b4-4bee-be08-c8ea3cee306a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:30.207379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc3ee-b6b4-4bee-be08-c8ea3cee306a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:30.207379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc3ee-b6b4-4bee-be08-c8ea3cee306a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:30.208741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:08:30.218691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:30.219608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:30.219608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:30.297241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: INFO dbcounter [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] Registered counter for database keystone Sep 03 01:08:30.318971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG oslo_db.sqlalchemy.engines [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:08:30.330863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writer thread running {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:08:30.511760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG passlib.handlers.bcrypt [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81480) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 03 01:08:30.512060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG passlib.handlers.bcrypt [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81480) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 03 01:08:30.572492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:30.574148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:30.707699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1/3] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 03 01:08:31.153771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bc3ee-b6b4-4bee-be08-c8ea3cee306a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:31.226199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: INFO dbcounter [None req-aa7bc3ee-b6b4-4bee-be08-c8ea3cee306a None None] Registered counter for database keystone Sep 03 01:08:31.251697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7bc3ee-b6b4-4bee-be08-c8ea3cee306a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:08:31.260113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writer thread running {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:08:31.377890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bc3ee-b6b4-4bee-be08-c8ea3cee306a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:31.383504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ad106-8375-4431-a907-4ce382b381ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:31.384138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ad106-8375-4431-a907-4ce382b381ec admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:31.384413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ad106-8375-4431-a907-4ce382b381ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:31.384687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ad106-8375-4431-a907-4ce382b381ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:31.393994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ad106-8375-4431-a907-4ce382b381ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:31.444068 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WARNING keystone.common.rbac_enforcer.enforcer [None req-310ad106-8375-4431-a907-4ce382b381ec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 03 01:08:31.444374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ad106-8375-4431-a907-4ce382b381ec admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:31.454510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 3/4] 10.222.0.39 () {58 vars in 1324 bytes} [Sat Sep 3 01:08:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:08:31.462318 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:31.481501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e9bf1-b823-4cec-8278-d46322faadbf None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:31.486671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbdc3a-25a7-4c19-bf80-6de65bd1701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:31.487856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbdc3a-25a7-4c19-bf80-6de65bd1701a admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:31.488140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbdc3a-25a7-4c19-bf80-6de65bd1701a admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:31.488414 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbdc3a-25a7-4c19-bf80-6de65bd1701a admin admin] PATH_INFO: `/v3/projects/ec3e6016635b4d4da63f35bc10e16abb` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:31.490059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbdc3a-25a7-4c19-bf80-6de65bd1701a admin admin] RBAC: Authorizing `identity:get_project(project_id=ec3e6016635b4d4da63f35bc10e16abb)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:31.541657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f5dbdc3a-25a7-4c19-bf80-6de65bd1701a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 03 01:08:31.542000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbdc3a-25a7-4c19-bf80-6de65bd1701a admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:31.546662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 2/5] 10.222.0.39 () {56 vars in 1207 bytes} [Sat Sep 3 01:08:31 2022] GET /identity/v3/projects/ec3e6016635b4d4da63f35bc10e16abb => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:33.454334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2c2a-fa15-4e72-9baf-0b2bbff32ee9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:33.454929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2c2a-fa15-4e72-9baf-0b2bbff32ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:33.454929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2c2a-fa15-4e72-9baf-0b2bbff32ee9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:33.461141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 4/6] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:33.467282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fc76d-b0f6-47ae-a4a6-7b8ada0c9ab2 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:33.467704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fc76d-b0f6-47ae-a4a6-7b8ada0c9ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:33.467801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fc76d-b0f6-47ae-a4a6-7b8ada0c9ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:33.488785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-866fc76d-b0f6-47ae-a4a6-7b8ada0c9ab2 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:33.490288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-866fc76d-b0f6-47ae-a4a6-7b8ada0c9ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:33.499324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 3/7] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 03 01:08:33.763738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f2c2a-fa15-4e72-9baf-0b2bbff32ee9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:33.779633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f2c2a-fa15-4e72-9baf-0b2bbff32ee9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:33.785431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77f5e9-978b-459a-92cc-196875a19478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:33.786041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f5e9-978b-459a-92cc-196875a19478 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:33.786316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f5e9-978b-459a-92cc-196875a19478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:33.786593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f5e9-978b-459a-92cc-196875a19478 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:33.794443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77f5e9-978b-459a-92cc-196875a19478 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:33.796240 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77f5e9-978b-459a-92cc-196875a19478 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:33.804956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1324 bytes} [Sat Sep 3 01:08:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:08:33.811515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fc76d-b0f6-47ae-a4a6-7b8ada0c9ab2 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:33.826835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fc76d-b0f6-47ae-a4a6-7b8ada0c9ab2 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:33.833779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47792770-ad5c-40ca-ac10-443e20a07abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:33.834409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47792770-ad5c-40ca-ac10-443e20a07abe admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:33.834685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47792770-ad5c-40ca-ac10-443e20a07abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:33.834951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47792770-ad5c-40ca-ac10-443e20a07abe admin admin] PATH_INFO: `/v3/users/f6ea32dae1644e03acb20487dc4a95a0` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:33.836441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47792770-ad5c-40ca-ac10-443e20a07abe admin admin] RBAC: Authorizing `identity:get_user(user_id=f6ea32dae1644e03acb20487dc4a95a0)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:33.838306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47792770-ad5c-40ca-ac10-443e20a07abe admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:33.839867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 4/9] 10.222.0.39 () {56 vars in 1198 bytes} [Sat Sep 3 01:08:33 2022] GET /identity/v3/users/f6ea32dae1644e03acb20487dc4a95a0 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:08:35.800291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f884bc-a8a2-4fe7-956e-151586afc6cc None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:35.800842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f884bc-a8a2-4fe7-956e-151586afc6cc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:35.800842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f884bc-a8a2-4fe7-956e-151586afc6cc None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:35.802216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:35.807607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb87a93-ea63-4ac8-b5cd-e13b524eb723 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:35.807997 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb87a93-ea63-4ac8-b5cd-e13b524eb723 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:35.808187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb87a93-ea63-4ac8-b5cd-e13b524eb723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:35.827802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-acb87a93-ea63-4ac8-b5cd-e13b524eb723 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:35.828986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-acb87a93-ea63-4ac8-b5cd-e13b524eb723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:35.861298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d479ee-2b3c-4228-904f-d2e1386c605b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:35.861552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d479ee-2b3c-4228-904f-d2e1386c605b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:35.861932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d479ee-2b3c-4228-904f-d2e1386c605b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:35.863723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 7/11] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:35.869008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07a54-cdb9-40ee-8745-97d542a7c0a6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:35.869292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07a54-cdb9-40ee-8745-97d542a7c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:35.869563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07a54-cdb9-40ee-8745-97d542a7c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:35.911853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 5/12] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:35.912278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG passlib.handlers.bcrypt [None req-1ec07a54-cdb9-40ee-8745-97d542a7c0a6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81481) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 03 01:08:35.912677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG passlib.handlers.bcrypt [None req-1ec07a54-cdb9-40ee-8745-97d542a7c0a6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81481) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 03 01:08:35.961406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1ec07a54-cdb9-40ee-8745-97d542a7c0a6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:35.962981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1ec07a54-cdb9-40ee-8745-97d542a7c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:36.066240 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 8/13] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:08:36.185778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb87a93-ea63-4ac8-b5cd-e13b524eb723 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:36.211971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:36.292314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb87a93-ea63-4ac8-b5cd-e13b524eb723 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:36.326474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141815f2-b788-41b3-9bc0-71c19e1008cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:36.327049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141815f2-b788-41b3-9bc0-71c19e1008cd None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:36.327355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141815f2-b788-41b3-9bc0-71c19e1008cd None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:36.327626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141815f2-b788-41b3-9bc0-71c19e1008cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:36.335033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec07a54-cdb9-40ee-8745-97d542a7c0a6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:36.339529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141815f2-b788-41b3-9bc0-71c19e1008cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-141815f2-b788-41b3-9bc0-71c19e1008cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:36.348699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:36.349816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:08:36.350808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 6/14] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:08:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:36.356021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141815f2-b788-41b3-9bc0-71c19e1008cd None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:36.437556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:36.439464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec07a54-cdb9-40ee-8745-97d542a7c0a6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:36.441973 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:36.457865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141815f2-b788-41b3-9bc0-71c19e1008cd None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:36.477843 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dd66b-87c4-4e74-ae83-39d16afc2760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:36.478721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dd66b-87c4-4e74-ae83-39d16afc2760 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:36.479034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dd66b-87c4-4e74-ae83-39d16afc2760 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:36.479303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dd66b-87c4-4e74-ae83-39d16afc2760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:36.492348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f2591-f2ac-44af-8120-c8a35743fa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:36.492954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2591-f2ac-44af-8120-c8a35743fa7f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:36.493254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2591-f2ac-44af-8120-c8a35743fa7f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:36.493485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2591-f2ac-44af-8120-c8a35743fa7f None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:36.494154 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f2591-f2ac-44af-8120-c8a35743fa7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:36.494451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f2591-f2ac-44af-8120-c8a35743fa7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:36.495851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f2591-f2ac-44af-8120-c8a35743fa7f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:36.507749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 7/15] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:08:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:36.513399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f2591-f2ac-44af-8120-c8a35743fa7f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:36.550414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dd66b-87c4-4e74-ae83-39d16afc2760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:36.552102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dd66b-87c4-4e74-ae83-39d16afc2760 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:36.614049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f2591-f2ac-44af-8120-c8a35743fa7f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:36.647174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a15898-814d-47c8-818e-c575ee2e316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:36.647823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a15898-814d-47c8-818e-c575ee2e316c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:36.648092 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a15898-814d-47c8-818e-c575ee2e316c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:36.648377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a15898-814d-47c8-818e-c575ee2e316c None admin] PATH_INFO: `/v3/users/f6ea32dae1644e03acb20487dc4a95a0` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:36.649517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a15898-814d-47c8-818e-c575ee2e316c None admin] RBAC: Authorizing `identity:get_user(user_id=f6ea32dae1644e03acb20487dc4a95a0)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:36.650975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a15898-814d-47c8-818e-c575ee2e316c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:36.652343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 9/16] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:08:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:08:36.652741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 8/17] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:36 2022] GET /identity/v3/users/f6ea32dae1644e03acb20487dc4a95a0 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:08:36.657947 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dd66b-87c4-4e74-ae83-39d16afc2760 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:36.658190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a15898-814d-47c8-818e-c575ee2e316c None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:36.660870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:36.673982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:36.756214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a15898-814d-47c8-818e-c575ee2e316c None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:36.759440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dd66b-87c4-4e74-ae83-39d16afc2760 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:36.790968 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248426-5810-4032-9450-4d887a6e83b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:36.791611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248426-5810-4032-9450-4d887a6e83b7 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:36.791893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248426-5810-4032-9450-4d887a6e83b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:36.792161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248426-5810-4032-9450-4d887a6e83b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:36.793291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248426-5810-4032-9450-4d887a6e83b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:36.794427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e83c1-ca93-4663-b419-a6c2871481f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:36.794754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248426-5810-4032-9450-4d887a6e83b7 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:36.795328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e83c1-ca93-4663-b419-a6c2871481f5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:36.795591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e83c1-ca93-4663-b419-a6c2871481f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:36.795860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e83c1-ca93-4663-b419-a6c2871481f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:36.796531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:36.802242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248426-5810-4032-9450-4d887a6e83b7 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:36.814301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e83c1-ca93-4663-b419-a6c2871481f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:36.815862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e83c1-ca93-4663-b419-a6c2871481f5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f55e83c1-ca93-4663-b419-a6c2871481f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:08:36.834565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:36.835516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:08:36.836325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:08:36.836325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:08:36.836325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:08:36.836325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:36.841791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e83c1-ca93-4663-b419-a6c2871481f5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:36.889387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:36.900003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:36.909293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248426-5810-4032-9450-4d887a6e83b7 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:36.941706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f5a1a-4668-4b50-9b50-44cea5a807d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:36.942313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5a1a-4668-4b50-9b50-44cea5a807d8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:36.942592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5a1a-4668-4b50-9b50-44cea5a807d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:36.942869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5a1a-4668-4b50-9b50-44cea5a807d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:36.943631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f5a1a-4668-4b50-9b50-44cea5a807d8 None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.domain.id=default, user.id=f6ea32dae1644e03acb20487dc4a95a0) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:36.943936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f5a1a-4668-4b50-9b50-44cea5a807d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:36.944876 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e83c1-ca93-4663-b419-a6c2871481f5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:36.945388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f5a1a-4668-4b50-9b50-44cea5a807d8 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:36.952541 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1322 bytes} [Sat Sep 3 01:08:36 2022] GET /identity/v3/role_assignments?user.id=f6ea32dae1644e03acb20487dc4a95a0&scope.domain.id=default&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:08:36.981814 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e34a82-c533-4c22-bdae-bed534cf7c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:36.982453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e34a82-c533-4c22-bdae-bed534cf7c5c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:36.982730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e34a82-c533-4c22-bdae-bed534cf7c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:36.982986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e34a82-c533-4c22-bdae-bed534cf7c5c None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:36.983687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e34a82-c533-4c22-bdae-bed534cf7c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:36.983988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e34a82-c533-4c22-bdae-bed534cf7c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:36.985420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e34a82-c533-4c22-bdae-bed534cf7c5c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:37.005582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:39.100226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1f6ee-4a14-42fb-81f8-e832a6c75350 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:39.101260 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1f6ee-4a14-42fb-81f8-e832a6c75350 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:39.101744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1f6ee-4a14-42fb-81f8-e832a6c75350 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:39.103505 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:39.109443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc42131-2ff1-498d-882d-c6eb4bb04816 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:39.110281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc42131-2ff1-498d-882d-c6eb4bb04816 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:39.110752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc42131-2ff1-498d-882d-c6eb4bb04816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:39.136308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cdc42131-2ff1-498d-882d-c6eb4bb04816 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:39.137846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cdc42131-2ff1-498d-882d-c6eb4bb04816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:39.216169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3466-6bb5-408f-9d6b-829da25f5945 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:39.216843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3466-6bb5-408f-9d6b-829da25f5945 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:39.217321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3466-6bb5-408f-9d6b-829da25f5945 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:39.218855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 12/23] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:39.230177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e123d-d874-48a3-b76e-5b4b9b15477b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:39.231192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e123d-d874-48a3-b76e-5b4b9b15477b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:39.231708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e123d-d874-48a3-b76e-5b4b9b15477b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:39.244709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:39.264654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-bc4e123d-d874-48a3-b76e-5b4b9b15477b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:39.266169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bc4e123d-d874-48a3-b76e-5b4b9b15477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:39.394286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:08:39.409381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954b2f6-dcee-4e67-b89a-e88fc7f5509a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:39.409974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954b2f6-dcee-4e67-b89a-e88fc7f5509a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:39.410437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954b2f6-dcee-4e67-b89a-e88fc7f5509a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:39.412011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 13/26] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:39.417392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33785076-c35c-4f45-9050-1e7bbcce45d3 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:39.417680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33785076-c35c-4f45-9050-1e7bbcce45d3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:39.417953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33785076-c35c-4f45-9050-1e7bbcce45d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:39.456388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-33785076-c35c-4f45-9050-1e7bbcce45d3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:39.457580 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-33785076-c35c-4f45-9050-1e7bbcce45d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:39.581003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:39.684788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954b2f6-dcee-4e67-b89a-e88fc7f5509a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:39.752469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:39.789759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d5e51-2d16-45fc-aa90-cca59f093367 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:39.790394 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d5e51-2d16-45fc-aa90-cca59f093367 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:39.790856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d5e51-2d16-45fc-aa90-cca59f093367 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:39.792434 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 15/28] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:08:39.804929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a0002-69b0-4278-b09a-c1fb92689e3c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:39.805781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a0002-69b0-4278-b09a-c1fb92689e3c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:39.806252 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a0002-69b0-4278-b09a-c1fb92689e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:39.821796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:39.838168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954b2f6-dcee-4e67-b89a-e88fc7f5509a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:39.840529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e03a0002-69b0-4278-b09a-c1fb92689e3c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:39.841731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e03a0002-69b0-4278-b09a-c1fb92689e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:39.910132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f11de-8b7f-4d05-832a-ad075a9e18e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:39.910789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f11de-8b7f-4d05-832a-ad075a9e18e8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:39.911067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f11de-8b7f-4d05-832a-ad075a9e18e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:39.911361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f11de-8b7f-4d05-832a-ad075a9e18e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:39.939573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f11de-8b7f-4d05-832a-ad075a9e18e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e31f11de-8b7f-4d05-832a-ad075a9e18e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:39.951102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:39.952051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:08:39.952801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:08:39.956383 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 14/29] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:08:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:39.957416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f11de-8b7f-4d05-832a-ad075a9e18e8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:39.977624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 16/30] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:08:39.978386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a0002-69b0-4278-b09a-c1fb92689e3c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:40.058586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f11de-8b7f-4d05-832a-ad075a9e18e8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:40.074434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:40.123866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5640b89-53fb-49ef-b817-8459d292df98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:40.124493 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5640b89-53fb-49ef-b817-8459d292df98 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:40.124758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5640b89-53fb-49ef-b817-8459d292df98 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:40.125026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5640b89-53fb-49ef-b817-8459d292df98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:40.141959 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5640b89-53fb-49ef-b817-8459d292df98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:40.143518 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5640b89-53fb-49ef-b817-8459d292df98 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:40.158835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a0002-69b0-4278-b09a-c1fb92689e3c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f5640b89-53fb-49ef-b817-8459d292df98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:08:40.173491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:40.174496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:08:40.175314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:08:40.175314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:08:40.175314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:08:40.175314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 15/31] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:40.178946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5640b89-53fb-49ef-b817-8459d292df98 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:40.226087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f971d-4084-40ea-8a2a-19e215943d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:40.226622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f971d-4084-40ea-8a2a-19e215943d95 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:40.226905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f971d-4084-40ea-8a2a-19e215943d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:40.227173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f971d-4084-40ea-8a2a-19e215943d95 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:40.227864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f971d-4084-40ea-8a2a-19e215943d95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:40.228160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f971d-4084-40ea-8a2a-19e215943d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:40.229551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f971d-4084-40ea-8a2a-19e215943d95 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:40.232394 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:40.249182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 17/32] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:08:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:40.250355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f971d-4084-40ea-8a2a-19e215943d95 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:40.312485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5640b89-53fb-49ef-b817-8459d292df98 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:40.348667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38ed89-320f-406a-b5a2-66b1c686b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:40.349669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38ed89-320f-406a-b5a2-66b1c686b01d None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:40.350139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38ed89-320f-406a-b5a2-66b1c686b01d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:40.350610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38ed89-320f-406a-b5a2-66b1c686b01d None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:40.351713 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38ed89-320f-406a-b5a2-66b1c686b01d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:40.353285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38ed89-320f-406a-b5a2-66b1c686b01d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:40.379451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f971d-4084-40ea-8a2a-19e215943d95 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:40.414850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1595e4-fb70-4116-aa1f-ffe84c015083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:40.415722 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1595e4-fb70-4116-aa1f-ffe84c015083 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:40.416070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1595e4-fb70-4116-aa1f-ffe84c015083 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:40.416391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1595e4-fb70-4116-aa1f-ffe84c015083 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:40.417037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1595e4-fb70-4116-aa1f-ffe84c015083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:40.417336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1595e4-fb70-4116-aa1f-ffe84c015083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:40.418813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1595e4-fb70-4116-aa1f-ffe84c015083 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:40.437568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 18/33] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:40.438439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1595e4-fb70-4116-aa1f-ffe84c015083 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:40.488944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 16/34] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Sep 3 01:08:40 2022] POST /identity/v3/roles => generated 219 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:08:40.496554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:40.498187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38ed89-320f-406a-b5a2-66b1c686b01d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:40.539196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:40.545685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1595e4-fb70-4116-aa1f-ffe84c015083 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:40.583546 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0925e5-ee9a-47bc-b63e-ac90bd1afc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:40.584211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0925e5-ee9a-47bc-b63e-ac90bd1afc6d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:40.584491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0925e5-ee9a-47bc-b63e-ac90bd1afc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:40.584764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0925e5-ee9a-47bc-b63e-ac90bd1afc6d None admin] PATH_INFO: `/v3/users/f6ea32dae1644e03acb20487dc4a95a0` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:40.585937 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0925e5-ee9a-47bc-b63e-ac90bd1afc6d None admin] RBAC: Authorizing `identity:get_user(user_id=f6ea32dae1644e03acb20487dc4a95a0)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:40.587466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0925e5-ee9a-47bc-b63e-ac90bd1afc6d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:40.589089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 19/35] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:40 2022] GET /identity/v3/users/f6ea32dae1644e03acb20487dc4a95a0 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:40.589856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0925e5-ee9a-47bc-b63e-ac90bd1afc6d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:40.717173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38ed89-320f-406a-b5a2-66b1c686b01d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:40.742731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0925e5-ee9a-47bc-b63e-ac90bd1afc6d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:40.758897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb4032-b9e7-4ecf-bbea-784c3e633656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:40.759571 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb4032-b9e7-4ecf-bbea-784c3e633656 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:40.759952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb4032-b9e7-4ecf-bbea-784c3e633656 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:40.760224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb4032-b9e7-4ecf-bbea-784c3e633656 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:40.761010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb4032-b9e7-4ecf-bbea-784c3e633656 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:40.762601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb4032-b9e7-4ecf-bbea-784c3e633656 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:40.766988 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:40.779339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17b408-4350-436c-a52b-35c4c1f4c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:40.780184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b408-4350-436c-a52b-35c4c1f4c880 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:40.780472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b408-4350-436c-a52b-35c4c1f4c880 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:40.780782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b408-4350-436c-a52b-35c4c1f4c880 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:40.781442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17b408-4350-436c-a52b-35c4c1f4c880 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:40.783065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17b408-4350-436c-a52b-35c4c1f4c880 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:40.785010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 17/36] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Sep 3 01:08:40 2022] POST /identity/v3/roles => generated 225 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:08:40.785967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb4032-b9e7-4ecf-bbea-784c3e633656 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:40.935568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb4032-b9e7-4ecf-bbea-784c3e633656 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:40.939661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:40.982883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13c4a1-2548-48dc-b79b-639fd6e2f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:40.983592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c4a1-2548-48dc-b79b-639fd6e2f25d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:40.983872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c4a1-2548-48dc-b79b-639fd6e2f25d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:40.984142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c4a1-2548-48dc-b79b-639fd6e2f25d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:40.985803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13c4a1-2548-48dc-b79b-639fd6e2f25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:40.987461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13c4a1-2548-48dc-b79b-639fd6e2f25d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:40.989534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 18/37] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:40.990711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6d73-79c4-4c81-96a3-3efdae8c5af0 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:40.990997 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6d73-79c4-4c81-96a3-3efdae8c5af0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:40.991344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6d73-79c4-4c81-96a3-3efdae8c5af0 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:40.992616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 19/38] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:40.993921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8fec1-3635-427f-a987-232115eab800 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:40.994138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8fec1-3635-427f-a987-232115eab800 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:40.994413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8fec1-3635-427f-a987-232115eab800 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:40.999935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 20/39] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:41.000916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8fec1-3635-427f-a987-232115eab800 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:41.091433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 20/40] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:08:40 2022] POST /identity/v3/projects => generated 301 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:08:41.092889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a668d4-b2f7-4752-a52b-277563bfb15c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:41.093200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a668d4-b2f7-4752-a52b-277563bfb15c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:41.093464 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a668d4-b2f7-4752-a52b-277563bfb15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:41.115820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8fec1-3635-427f-a987-232115eab800 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:41.117286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e1a668d4-b2f7-4752-a52b-277563bfb15c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:41.118855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e1a668d4-b2f7-4752-a52b-277563bfb15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:41.156456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105d278-ad40-432d-a5fa-8a5f417ff5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:41.157181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105d278-ad40-432d-a5fa-8a5f417ff5d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:41.157457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105d278-ad40-432d-a5fa-8a5f417ff5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:41.157705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105d278-ad40-432d-a5fa-8a5f417ff5d0 None admin] PATH_INFO: `/v3/domains/default/users/f6ea32dae1644e03acb20487dc4a95a0/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:41.160660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105d278-ad40-432d-a5fa-8a5f417ff5d0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f6ea32dae1644e03acb20487dc4a95a0, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:41.162152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105d278-ad40-432d-a5fa-8a5f417ff5d0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:41.184090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 21/41] 10.222.0.39 () {58 vars in 1361 bytes} [Sat Sep 3 01:08:40 2022] PUT /identity/v3/domains/default/users/f6ea32dae1644e03acb20487dc4a95a0/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:08:41.185930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfa07a-5228-4ed7-a35f-ce2085fa513a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:41.186528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfa07a-5228-4ed7-a35f-ce2085fa513a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:41.187391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfa07a-5228-4ed7-a35f-ce2085fa513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:41.204681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:41.204924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 21/42] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:41.218015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-35cfa07a-5228-4ed7-a35f-ce2085fa513a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:41.221884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-35cfa07a-5228-4ed7-a35f-ce2085fa513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:41.307128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 22/43] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:41.480507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a668d4-b2f7-4752-a52b-277563bfb15c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:41.577984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfa07a-5228-4ed7-a35f-ce2085fa513a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:41.588931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a668d4-b2f7-4752-a52b-277563bfb15c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:41.597600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:41.630213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d4ad4-945e-4a08-9c5e-ca870ec31386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:41.630934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d4ad4-945e-4a08-9c5e-ca870ec31386 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:41.631223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d4ad4-945e-4a08-9c5e-ca870ec31386 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:41.631568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d4ad4-945e-4a08-9c5e-ca870ec31386 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:41.632754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d4ad4-945e-4a08-9c5e-ca870ec31386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:41.634600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d4ad4-945e-4a08-9c5e-ca870ec31386 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:41.636467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 22/44] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:41.641782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d4ad4-945e-4a08-9c5e-ca870ec31386 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:41.692507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfa07a-5228-4ed7-a35f-ce2085fa513a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:41.727679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a727d-dfdd-49a7-8f73-e9251dbdb7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:41.728288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a727d-dfdd-49a7-8f73-e9251dbdb7c6 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:41.728669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a727d-dfdd-49a7-8f73-e9251dbdb7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:41.728941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a727d-dfdd-49a7-8f73-e9251dbdb7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:41.729622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a727d-dfdd-49a7-8f73-e9251dbdb7c6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:41.731379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a727d-dfdd-49a7-8f73-e9251dbdb7c6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:41.736114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:41.745234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d4ad4-945e-4a08-9c5e-ca870ec31386 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:41.752189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 23/45] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Sep 3 01:08:41 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:08:41.785404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60703768-eef9-422e-b2de-0f9f139e6fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:41.786045 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703768-eef9-422e-b2de-0f9f139e6fc6 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:41.786331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703768-eef9-422e-b2de-0f9f139e6fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:41.786606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703768-eef9-422e-b2de-0f9f139e6fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:41.787314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60703768-eef9-422e-b2de-0f9f139e6fc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:41.788820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60703768-eef9-422e-b2de-0f9f139e6fc6 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:41.820152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:08:41 2022] POST /identity/v3/projects => generated 312 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:08:43.114496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dfc6f-6ccc-4698-9429-04e93b3c4931 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:43.115041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dfc6f-6ccc-4698-9429-04e93b3c4931 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:43.115041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dfc6f-6ccc-4698-9429-04e93b3c4931 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:43.116416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 24/47] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:43.121622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db7d6e-b415-4edb-bf37-f74ff520a76b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:43.122026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db7d6e-b415-4edb-bf37-f74ff520a76b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:43.122156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db7d6e-b415-4edb-bf37-f74ff520a76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:43.140581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-42db7d6e-b415-4edb-bf37-f74ff520a76b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:43.141754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-42db7d6e-b415-4edb-bf37-f74ff520a76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:43.163916 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:43.213233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 24/48] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:43.478612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dfc6f-6ccc-4698-9429-04e93b3c4931 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:43.584371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dfc6f-6ccc-4698-9429-04e93b3c4931 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:43.619168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a8ab-8197-471e-a413-bdc72ce17b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:43.619826 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a8ab-8197-471e-a413-bdc72ce17b5c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:43.620110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a8ab-8197-471e-a413-bdc72ce17b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:43.620375 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a8ab-8197-471e-a413-bdc72ce17b5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:43.631156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513a8ab-8197-471e-a413-bdc72ce17b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0513a8ab-8197-471e-a413-bdc72ce17b5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:43.636104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:43.637066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:08:43.637794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 25/49] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:43.643298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db7d6e-b415-4edb-bf37-f74ff520a76b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:43.705860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac05872-99b1-42c5-9a09-55e51d89c844 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:43.706136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac05872-99b1-42c5-9a09-55e51d89c844 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:43.706381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac05872-99b1-42c5-9a09-55e51d89c844 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:43.707797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 26/50] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:08:43.712663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737fd3f-81b8-48b0-b592-30809a238c33 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:43.712950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737fd3f-81b8-48b0-b592-30809a238c33 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:43.713231 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737fd3f-81b8-48b0-b592-30809a238c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:43.733581 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5737fd3f-81b8-48b0-b592-30809a238c33 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:43.734675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5737fd3f-81b8-48b0-b592-30809a238c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:43.746488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db7d6e-b415-4edb-bf37-f74ff520a76b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:43.779443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd9a65-6454-45bc-9186-1d183e679d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:43.780045 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd9a65-6454-45bc-9186-1d183e679d3a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:43.780325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd9a65-6454-45bc-9186-1d183e679d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:43.780602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd9a65-6454-45bc-9186-1d183e679d3a None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:43.781272 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd9a65-6454-45bc-9186-1d183e679d3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:43.781576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd9a65-6454-45bc-9186-1d183e679d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:43.782977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd9a65-6454-45bc-9186-1d183e679d3a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:43.783386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:43.791226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 25/51] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:43.796903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd9a65-6454-45bc-9186-1d183e679d3a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:43.801561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 27/52] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:08:43.815682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:43.897635 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd9a65-6454-45bc-9186-1d183e679d3a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:43.931589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d8985-609f-45cd-9d18-3bee5fccdb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:43.932242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d8985-609f-45cd-9d18-3bee5fccdb10 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:43.932502 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d8985-609f-45cd-9d18-3bee5fccdb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:43.932776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d8985-609f-45cd-9d18-3bee5fccdb10 None admin] PATH_INFO: `/v3/users/f6ea32dae1644e03acb20487dc4a95a0` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:43.933969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d8985-609f-45cd-9d18-3bee5fccdb10 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ea32dae1644e03acb20487dc4a95a0)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:43.935469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d8985-609f-45cd-9d18-3bee5fccdb10 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:43.937045 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:43 2022] GET /identity/v3/users/f6ea32dae1644e03acb20487dc4a95a0 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:08:43.942912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737fd3f-81b8-48b0-b592-30809a238c33 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:44.042457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737fd3f-81b8-48b0-b592-30809a238c33 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:44.066581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d8985-609f-45cd-9d18-3bee5fccdb10 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:44.078217 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdc612-82b6-4193-bb8c-2a034a0f5773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:44.078855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdc612-82b6-4193-bb8c-2a034a0f5773 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:44.079136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdc612-82b6-4193-bb8c-2a034a0f5773 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:44.079442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdc612-82b6-4193-bb8c-2a034a0f5773 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:44.080566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdc612-82b6-4193-bb8c-2a034a0f5773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:44.082027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdc612-82b6-4193-bb8c-2a034a0f5773 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:44.083631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 28/54] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:44.089426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdc612-82b6-4193-bb8c-2a034a0f5773 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:44.156792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:44.173472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d8985-609f-45cd-9d18-3bee5fccdb10 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:44.211787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a26cdf-d3a8-4a66-b733-3b4f1f3849a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:44.212439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a26cdf-d3a8-4a66-b733-3b4f1f3849a5 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:44.212723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a26cdf-d3a8-4a66-b733-3b4f1f3849a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:44.212995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a26cdf-d3a8-4a66-b733-3b4f1f3849a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:44.214184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a26cdf-d3a8-4a66-b733-3b4f1f3849a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:44.215719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a26cdf-d3a8-4a66-b733-3b4f1f3849a5 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:44.217383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:44.223208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a26cdf-d3a8-4a66-b733-3b4f1f3849a5 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:44.253486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:44.297472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdc612-82b6-4193-bb8c-2a034a0f5773 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:44.325788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a26cdf-d3a8-4a66-b733-3b4f1f3849a5 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:44.331622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93e492-a328-446b-b357-7977e0a076ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:44.332235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93e492-a328-446b-b357-7977e0a076ce None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:44.332513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93e492-a328-446b-b357-7977e0a076ce None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:44.332782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93e492-a328-446b-b357-7977e0a076ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:44.333506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93e492-a328-446b-b357-7977e0a076ce None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.domain.id=default, user.id=f6ea32dae1644e03acb20487dc4a95a0) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:44.333810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93e492-a328-446b-b357-7977e0a076ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:44.335268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93e492-a328-446b-b357-7977e0a076ce None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:44.343110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 29/56] 10.222.0.39 () {56 vars in 1322 bytes} [Sat Sep 3 01:08:44 2022] GET /identity/v3/role_assignments?user.id=f6ea32dae1644e03acb20487dc4a95a0&scope.domain.id=default&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 530 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:08:44.360617 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e13cda-2bb4-44bb-a7ca-ccdad8ae569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:44.361251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e13cda-2bb4-44bb-a7ca-ccdad8ae569b None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:44.361528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e13cda-2bb4-44bb-a7ca-ccdad8ae569b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:44.361969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e13cda-2bb4-44bb-a7ca-ccdad8ae569b None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:44.362728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e13cda-2bb4-44bb-a7ca-ccdad8ae569b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:44.364180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e13cda-2bb4-44bb-a7ca-ccdad8ae569b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:44.397312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 28/57] 10.222.0.39 () {60 vars in 1140 bytes} [Sat Sep 3 01:08:44 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:08:46.279459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce889-b668-4b80-a071-2ec99e51c688 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:46.280268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce889-b668-4b80-a071-2ec99e51c688 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:46.280268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce889-b668-4b80-a071-2ec99e51c688 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:46.282564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 30/58] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:46.288098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3080bc-7ae2-45cc-84e7-5ddd146adc84 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:46.288523 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3080bc-7ae2-45cc-84e7-5ddd146adc84 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:46.288610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3080bc-7ae2-45cc-84e7-5ddd146adc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:46.302576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:46.308425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6f3080bc-7ae2-45cc-84e7-5ddd146adc84 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:46.311127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6f3080bc-7ae2-45cc-84e7-5ddd146adc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:46.393232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 29/59] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:46.657791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bce889-b668-4b80-a071-2ec99e51c688 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:46.764188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bce889-b668-4b80-a071-2ec99e51c688 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:46.787261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:46.805432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9318a-2fad-4940-b33b-48b81d36eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:46.806051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9318a-2fad-4940-b33b-48b81d36eb53 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:46.806326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9318a-2fad-4940-b33b-48b81d36eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:46.806591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9318a-2fad-4940-b33b-48b81d36eb53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:46.807739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9318a-2fad-4940-b33b-48b81d36eb53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:46.809166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9318a-2fad-4940-b33b-48b81d36eb53 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:46.810705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 31/60] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:46.816495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3080bc-7ae2-45cc-84e7-5ddd146adc84 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:46.923335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3080bc-7ae2-45cc-84e7-5ddd146adc84 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:46.958350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836ae9a-186f-4e35-a057-6a7e5f027003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:46.958951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836ae9a-186f-4e35-a057-6a7e5f027003 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:46.959228 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836ae9a-186f-4e35-a057-6a7e5f027003 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:46.959527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836ae9a-186f-4e35-a057-6a7e5f027003 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:46.960182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836ae9a-186f-4e35-a057-6a7e5f027003 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:46.961636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836ae9a-186f-4e35-a057-6a7e5f027003 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:46.973877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:46.993666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 30/61] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:08:46 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:08:49.973297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39168bfc-2b1b-4da8-9985-385d98c8ebd9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:49.974322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39168bfc-2b1b-4da8-9985-385d98c8ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:49.974805 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39168bfc-2b1b-4da8-9985-385d98c8ebd9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:49.976414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 32/62] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:49.982041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e690-1359-401b-876c-0c778bdc95cf None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:49.982825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e690-1359-401b-876c-0c778bdc95cf None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:49.983320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e690-1359-401b-876c-0c778bdc95cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:50.009247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4854e690-1359-401b-876c-0c778bdc95cf None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:50.010457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4854e690-1359-401b-876c-0c778bdc95cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:50.116622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 31/63] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:50.227019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6ddd0-9077-491c-a993-44c387497181 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:50.227388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6ddd0-9077-491c-a993-44c387497181 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:50.227772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6ddd0-9077-491c-a993-44c387497181 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:50.229270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 33/64] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:50.235039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f477f-51c4-4e26-b705-8113da4b5e72 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:50.235377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f477f-51c4-4e26-b705-8113da4b5e72 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:50.235661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f477f-51c4-4e26-b705-8113da4b5e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:50.272921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a14f477f-51c4-4e26-b705-8113da4b5e72 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:50.274126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a14f477f-51c4-4e26-b705-8113da4b5e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:50.371345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a8e1-a1f4-40b0-af18-949e7657f195 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:50.371989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a8e1-a1f4-40b0-af18-949e7657f195 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:50.372457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a8e1-a1f4-40b0-af18-949e7657f195 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:50.374070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 34/65] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:08:50.384465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce81e8-6713-4729-a4d6-43445fb067af None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:50.385036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce81e8-6713-4729-a4d6-43445fb067af None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:50.385506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce81e8-6713-4729-a4d6-43445fb067af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:50.389597 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 32/66] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:50.413391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e0ce81e8-6713-4729-a4d6-43445fb067af None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:50.415050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e0ce81e8-6713-4729-a4d6-43445fb067af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:50.425255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f477f-51c4-4e26-b705-8113da4b5e72 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:50.482698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:50.534626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 35/67] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:50.536497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648fcd9-1458-4208-b7bd-7eebc992666b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:50.536944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648fcd9-1458-4208-b7bd-7eebc992666b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:50.537374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648fcd9-1458-4208-b7bd-7eebc992666b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:50.538902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 36/68] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:50.548920 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f265b7-bf1a-4d22-b43f-450fb97c856b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:50.549439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f265b7-bf1a-4d22-b43f-450fb97c856b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:50.550005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f265b7-bf1a-4d22-b43f-450fb97c856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:50.585196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-50f265b7-bf1a-4d22-b43f-450fb97c856b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:50.590122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-50f265b7-bf1a-4d22-b43f-450fb97c856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:50.598399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f477f-51c4-4e26-b705-8113da4b5e72 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:50.673260 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdbcbe-a09d-44c5-8016-762391339065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:50.674209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdbcbe-a09d-44c5-8016-762391339065 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:50.674808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdbcbe-a09d-44c5-8016-762391339065 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:50.675370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdbcbe-a09d-44c5-8016-762391339065 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:50.697485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdbcbe-a09d-44c5-8016-762391339065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-fbfdbcbe-a09d-44c5-8016-762391339065 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:50.705649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:50.707165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:08:50.708151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:08:50.709466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 33/69] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:08:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:08:50.710730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdbcbe-a09d-44c5-8016-762391339065 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:50.725915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 37/70] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:08:50.727047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f265b7-bf1a-4d22-b43f-450fb97c856b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:50.822481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:50.891362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdbcbe-a09d-44c5-8016-762391339065 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:50.904902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f265b7-bf1a-4d22-b43f-450fb97c856b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:50.905864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:50.928636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d8ec-7e29-462d-90d1-a0d21425befa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:50.929509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d8ec-7e29-462d-90d1-a0d21425befa None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:50.929931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d8ec-7e29-462d-90d1-a0d21425befa None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:50.930343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d8ec-7e29-462d-90d1-a0d21425befa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:50.940776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765f00b-6cfe-4207-925e-e27ef2837a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:50.941364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765f00b-6cfe-4207-925e-e27ef2837a22 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:50.941586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765f00b-6cfe-4207-925e-e27ef2837a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:50.941856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765f00b-6cfe-4207-925e-e27ef2837a22 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:50.942277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4d8ec-7e29-462d-90d1-a0d21425befa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:50.942574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765f00b-6cfe-4207-925e-e27ef2837a22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:50.942879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765f00b-6cfe-4207-925e-e27ef2837a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:50.944426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765f00b-6cfe-4207-925e-e27ef2837a22 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-5ad4d8ec-7e29-462d-90d1-a0d21425befa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:50.948405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:50.949261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:08:50.949999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:08:50.952493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 34/71] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:08:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:50.953450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d8ec-7e29-462d-90d1-a0d21425befa None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:50.963598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 38/72] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:08:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:50.968580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765f00b-6cfe-4207-925e-e27ef2837a22 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:51.068251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d8ec-7e29-462d-90d1-a0d21425befa None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:51.068782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765f00b-6cfe-4207-925e-e27ef2837a22 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:51.077648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:51.103080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680ba49-4363-4f25-8023-664a6539093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:51.103644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5a64-7c92-4720-a303-618440ea73c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:51.103754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ba49-4363-4f25-8023-664a6539093a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.103981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ba49-4363-4f25-8023-664a6539093a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.104247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ba49-4363-4f25-8023-664a6539093a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.104331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5a64-7c92-4720-a303-618440ea73c2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.104557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5a64-7c92-4720-a303-618440ea73c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.104839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5a64-7c92-4720-a303-618440ea73c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.104922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680ba49-4363-4f25-8023-664a6539093a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:51.105188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680ba49-4363-4f25-8023-664a6539093a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:51.106922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680ba49-4363-4f25-8023-664a6539093a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:51.114695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 39/73] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:08:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:51.115823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e5a64-7c92-4720-a303-618440ea73c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:51.115935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838295f8-f9ed-4c32-8adc-81f4de231adf None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.116131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838295f8-f9ed-4c32-8adc-81f4de231adf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.116552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838295f8-f9ed-4c32-8adc-81f4de231adf None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.117869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 40/74] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:51.118679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838295f8-f9ed-4c32-8adc-81f4de231adf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-747e5a64-7c92-4720-a303-618440ea73c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:51.121107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:51.121928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:08:51.122683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:08:51.123971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 35/75] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:08:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:51.124164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5a64-7c92-4720-a303-618440ea73c2 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:51.156236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:51.224593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838295f8-f9ed-4c32-8adc-81f4de231adf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:51.229059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5a64-7c92-4720-a303-618440ea73c2 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:51.257199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c85e-5685-45f8-90fd-2b090783ac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:51.257835 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c85e-5685-45f8-90fd-2b090783ac6d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.258110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c85e-5685-45f8-90fd-2b090783ac6d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.258380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c85e-5685-45f8-90fd-2b090783ac6d None admin] PATH_INFO: `/v3/users/f6ea32dae1644e03acb20487dc4a95a0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.259521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8c85e-5685-45f8-90fd-2b090783ac6d None admin] RBAC: Authorizing `identity:get_user(user_id=f6ea32dae1644e03acb20487dc4a95a0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:51.260948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8c85e-5685-45f8-90fd-2b090783ac6d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:51.262531 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 41/76] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:51 2022] GET /identity/v3/users/f6ea32dae1644e03acb20487dc4a95a0 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:51.262767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5dd75-31c0-455d-b0fd-ec652a7feba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:51.263308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c85e-5685-45f8-90fd-2b090783ac6d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:51.263484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5dd75-31c0-455d-b0fd-ec652a7feba1 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.263747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5dd75-31c0-455d-b0fd-ec652a7feba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.264024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5dd75-31c0-455d-b0fd-ec652a7feba1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.278156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5dd75-31c0-455d-b0fd-ec652a7feba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-39f5dd75-31c0-455d-b0fd-ec652a7feba1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:51.283100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:51.284315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 36/77] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:08:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:51.288179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f13026-ce41-48f3-9333-d923f1b02790 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.288924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f13026-ce41-48f3-9333-d923f1b02790 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.288924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f13026-ce41-48f3-9333-d923f1b02790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.304341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-75f13026-ce41-48f3-9333-d923f1b02790 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:51.305559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-75f13026-ce41-48f3-9333-d923f1b02790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:51.313609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:51.371418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 37/78] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:51.372183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f13026-ce41-48f3-9333-d923f1b02790 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:51.386544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c85e-5685-45f8-90fd-2b090783ac6d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:51.396746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:51.421585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48d138-7a56-4a92-82f1-d24d665b58d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:51.422219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d138-7a56-4a92-82f1-d24d665b58d2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.422497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d138-7a56-4a92-82f1-d24d665b58d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.422765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d138-7a56-4a92-82f1-d24d665b58d2 None admin] PATH_INFO: `/v3/users/66691c32d587443cb7787f9e28a6a013` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.438268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48d138-7a56-4a92-82f1-d24d665b58d2 None admin] RBAC: Authorizing `identity:get_user(user_id=66691c32d587443cb7787f9e28a6a013)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:51.439869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48d138-7a56-4a92-82f1-d24d665b58d2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:51.441764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 42/79] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:51 2022] GET /identity/v3/users/66691c32d587443cb7787f9e28a6a013 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:51.442541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48d138-7a56-4a92-82f1-d24d665b58d2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:51.482006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f13026-ce41-48f3-9333-d923f1b02790 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:51.517707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dced23-9307-4f2d-a23e-709ff06b5f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:51.518322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dced23-9307-4f2d-a23e-709ff06b5f27 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.518612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dced23-9307-4f2d-a23e-709ff06b5f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.518887 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dced23-9307-4f2d-a23e-709ff06b5f27 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.519592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dced23-9307-4f2d-a23e-709ff06b5f27 None admin] RBAC: Adding query filter params (name=member) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:51.519895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dced23-9307-4f2d-a23e-709ff06b5f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:51.521306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dced23-9307-4f2d-a23e-709ff06b5f27 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:51.534410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 38/80] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:08:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:51.534410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dced23-9307-4f2d-a23e-709ff06b5f27 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:51.548909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:51.555117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48d138-7a56-4a92-82f1-d24d665b58d2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:51.590644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b581a-dc99-4514-b04c-612be70c6102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:51.591276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b581a-dc99-4514-b04c-612be70c6102 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.591584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b581a-dc99-4514-b04c-612be70c6102 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.591862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b581a-dc99-4514-b04c-612be70c6102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.617344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:51.633737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dced23-9307-4f2d-a23e-709ff06b5f27 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:51.664991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b581a-dc99-4514-b04c-612be70c6102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:51.666503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b581a-dc99-4514-b04c-612be70c6102 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:51.668002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afccb1b-1bea-4161-bfe4-f23f29ea0ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:51.668616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afccb1b-1bea-4161-bfe4-f23f29ea0ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.668893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afccb1b-1bea-4161-bfe4-f23f29ea0ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.669168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afccb1b-1bea-4161-bfe4-f23f29ea0ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.669827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afccb1b-1bea-4161-bfe4-f23f29ea0ef0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:51.670126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afccb1b-1bea-4161-bfe4-f23f29ea0ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:51.671558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afccb1b-1bea-4161-bfe4-f23f29ea0ef0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:51.679973 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 39/81] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:08:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:51.685572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afccb1b-1bea-4161-bfe4-f23f29ea0ef0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:51.757856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:51.764445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 43/82] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:08:51.765518 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b581a-dc99-4514-b04c-612be70c6102 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:51.786196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afccb1b-1bea-4161-bfe4-f23f29ea0ef0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:51.818684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f1b78-acb8-41c3-834d-e9b557fb1a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:51.819327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1b78-acb8-41c3-834d-e9b557fb1a2b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.819615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1b78-acb8-41c3-834d-e9b557fb1a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.819892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1b78-acb8-41c3-834d-e9b557fb1a2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.835037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:51.861634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b581a-dc99-4514-b04c-612be70c6102 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:51.890107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f1b78-acb8-41c3-834d-e9b557fb1a2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:51.891579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f1b78-acb8-41c3-834d-e9b557fb1a2b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:51.895296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7089c-5e20-4105-ae69-c4eb660a1b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:51.895945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7089c-5e20-4105-ae69-c4eb660a1b6a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:51.896230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7089c-5e20-4105-ae69-c4eb660a1b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:51.896504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7089c-5e20-4105-ae69-c4eb660a1b6a None admin] PATH_INFO: `/v3/users/66691c32d587443cb7787f9e28a6a013` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:51.897645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7089c-5e20-4105-ae69-c4eb660a1b6a None admin] RBAC: Authorizing `identity:get_user(user_id=66691c32d587443cb7787f9e28a6a013)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:51.899082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7089c-5e20-4105-ae69-c4eb660a1b6a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:51.900707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 44/83] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:51 2022] GET /identity/v3/users/66691c32d587443cb7787f9e28a6a013 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:51.901472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7089c-5e20-4105-ae69-c4eb660a1b6a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:51.964363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:51.997688 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 40/84] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:08:51.998728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f1b78-acb8-41c3-834d-e9b557fb1a2b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:52.008808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7089c-5e20-4105-ae69-c4eb660a1b6a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:52.043996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:52.044320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87e09d-7023-4a2d-8a7d-77f33fdc7e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:52.045022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e09d-7023-4a2d-8a7d-77f33fdc7e80 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:52.045438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e09d-7023-4a2d-8a7d-77f33fdc7e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:52.045699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e09d-7023-4a2d-8a7d-77f33fdc7e80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:52.047010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87e09d-7023-4a2d-8a7d-77f33fdc7e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:52.048491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87e09d-7023-4a2d-8a7d-77f33fdc7e80 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:52.050343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 45/85] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:52.051119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87e09d-7023-4a2d-8a7d-77f33fdc7e80 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:52.101966 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f1b78-acb8-41c3-834d-e9b557fb1a2b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:52.135761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da468c-54f9-4744-a9a1-290f1747db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:52.136395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da468c-54f9-4744-a9a1-290f1747db40 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:52.136675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da468c-54f9-4744-a9a1-290f1747db40 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:52.137006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da468c-54f9-4744-a9a1-290f1747db40 None admin] PATH_INFO: `/v3/users/66691c32d587443cb7787f9e28a6a013` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:52.138143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da468c-54f9-4744-a9a1-290f1747db40 None admin] RBAC: Authorizing `identity:get_user(user_id=66691c32d587443cb7787f9e28a6a013)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:52.139648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da468c-54f9-4744-a9a1-290f1747db40 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:52.141301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 41/86] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:51 2022] GET /identity/v3/users/66691c32d587443cb7787f9e28a6a013 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:52.144422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da468c-54f9-4744-a9a1-290f1747db40 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:52.149900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87e09d-7023-4a2d-8a7d-77f33fdc7e80 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:52.182562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:52.188459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cc1b4-f567-4b07-9f5d-8167b5ef7c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:52.189112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cc1b4-f567-4b07-9f5d-8167b5ef7c96 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:52.189393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cc1b4-f567-4b07-9f5d-8167b5ef7c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:52.189683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cc1b4-f567-4b07-9f5d-8167b5ef7c96 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:52.193436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cc1b4-f567-4b07-9f5d-8167b5ef7c96 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:52.194901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cc1b4-f567-4b07-9f5d-8167b5ef7c96 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:52.196603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 46/87] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:08:52 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:52.197368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cc1b4-f567-4b07-9f5d-8167b5ef7c96 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:52.253697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da468c-54f9-4744-a9a1-290f1747db40 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:52.267030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:52.287793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae795bcc-bf80-4770-a247-3e2732492633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:52.288407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae795bcc-bf80-4770-a247-3e2732492633 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:52.288687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae795bcc-bf80-4770-a247-3e2732492633 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:52.288961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae795bcc-bf80-4770-a247-3e2732492633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:52.297222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cc1b4-f567-4b07-9f5d-8167b5ef7c96 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:52.331048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed24694-adf3-470e-a44d-558bb030d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:52.331702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed24694-adf3-470e-a44d-558bb030d491 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:52.331975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed24694-adf3-470e-a44d-558bb030d491 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:52.332243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed24694-adf3-470e-a44d-558bb030d491 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:52.333394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed24694-adf3-470e-a44d-558bb030d491 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:52.334844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed24694-adf3-470e-a44d-558bb030d491 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:52.336500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 47/88] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:08:52 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:52.337237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed24694-adf3-470e-a44d-558bb030d491 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:52.358253 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae795bcc-bf80-4770-a247-3e2732492633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:52.359775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae795bcc-bf80-4770-a247-3e2732492633 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:52.401735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:52.436730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed24694-adf3-470e-a44d-558bb030d491 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:52.457852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 42/89] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:08:52.459097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae795bcc-bf80-4770-a247-3e2732492633 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:52.473105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:52.474954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5696d1-e4b1-43ef-a15b-7bccfd7a8f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:52.475651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5696d1-e4b1-43ef-a15b-7bccfd7a8f4e None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:52.475938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5696d1-e4b1-43ef-a15b-7bccfd7a8f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:52.476215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5696d1-e4b1-43ef-a15b-7bccfd7a8f4e None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:52.476876 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5696d1-e4b1-43ef-a15b-7bccfd7a8f4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:52.478326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5696d1-e4b1-43ef-a15b-7bccfd7a8f4e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:52.507854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 48/90] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:08:52 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:08:52.508748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5696d1-e4b1-43ef-a15b-7bccfd7a8f4e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:52.571509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae795bcc-bf80-4770-a247-3e2732492633 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:52.611125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6713fa-85a1-49f5-978c-d64db342c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:52.612362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6713fa-85a1-49f5-978c-d64db342c860 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:52.612808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6713fa-85a1-49f5-978c-d64db342c860 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:52.613090 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6713fa-85a1-49f5-978c-d64db342c860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:52.622235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5696d1-e4b1-43ef-a15b-7bccfd7a8f4e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:52.648433 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:52.664927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dece8-427b-443e-8668-94a8c4c6148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:52.665450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dece8-427b-443e-8668-94a8c4c6148a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:52.665735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dece8-427b-443e-8668-94a8c4c6148a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:52.666013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dece8-427b-443e-8668-94a8c4c6148a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:52.667960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dece8-427b-443e-8668-94a8c4c6148a None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64, user.id=f6ea32dae1644e03acb20487dc4a95a0) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:52.667960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dece8-427b-443e-8668-94a8c4c6148a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:52.669190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dece8-427b-443e-8668-94a8c4c6148a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:52.675754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 49/91] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:08:52 2022] GET /identity/v3/role_assignments?user.id=f6ea32dae1644e03acb20487dc4a95a0&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:52.676588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dece8-427b-443e-8668-94a8c4c6148a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:52.689374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6713fa-85a1-49f5-978c-d64db342c860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:52.691052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6713fa-85a1-49f5-978c-d64db342c860 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:52.707040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:52.817822 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dece8-427b-443e-8668-94a8c4c6148a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:52.825130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 43/92] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:08:52.826023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6713fa-85a1-49f5-978c-d64db342c860 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:52.869373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6492a7d-0747-4e3c-b117-8ba0e56064db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:52.870006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492a7d-0747-4e3c-b117-8ba0e56064db None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:52.870290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492a7d-0747-4e3c-b117-8ba0e56064db None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:52.870569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492a7d-0747-4e3c-b117-8ba0e56064db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:52.871432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6492a7d-0747-4e3c-b117-8ba0e56064db None admin] RBAC: Adding query filter params (role.id=4111136d5e114c4b9ca719aa39f4bc23, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64, user.id=66691c32d587443cb7787f9e28a6a013) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:52.871748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6492a7d-0747-4e3c-b117-8ba0e56064db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:52.873214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6492a7d-0747-4e3c-b117-8ba0e56064db None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:52.880433 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 50/93] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:08:52 2022] GET /identity/v3/role_assignments?user.id=66691c32d587443cb7787f9e28a6a013&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=4111136d5e114c4b9ca719aa39f4bc23 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:52.888508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6492a7d-0747-4e3c-b117-8ba0e56064db None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:52.987829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:52.997424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6713fa-85a1-49f5-978c-d64db342c860 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:53.029929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:53.068753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968cea8-cf44-4359-a479-c4ce46ac674a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:53.069407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968cea8-cf44-4359-a479-c4ce46ac674a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:53.069690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968cea8-cf44-4359-a479-c4ce46ac674a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:53.069965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968cea8-cf44-4359-a479-c4ce46ac674a None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:53.071235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968cea8-cf44-4359-a479-c4ce46ac674a None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:53.072747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968cea8-cf44-4359-a479-c4ce46ac674a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:53.074584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 44/94] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:08:52 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:53.086781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6492a7d-0747-4e3c-b117-8ba0e56064db None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:53.089672 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968cea8-cf44-4359-a479-c4ce46ac674a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:53.171989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4ce71-1da3-40d8-844f-8a95a2888d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:53.172666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4ce71-1da3-40d8-844f-8a95a2888d3b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:53.172930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4ce71-1da3-40d8-844f-8a95a2888d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:53.173208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4ce71-1da3-40d8-844f-8a95a2888d3b None admin] PATH_INFO: `/v3/projects/eef7c79d7cc64aec9dd4549226048f7b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:53.174442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4ce71-1da3-40d8-844f-8a95a2888d3b None admin] RBAC: Authorizing `identity:get_project(project_id=eef7c79d7cc64aec9dd4549226048f7b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:53.175952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4ce71-1da3-40d8-844f-8a95a2888d3b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:53.177656 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 51/95] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:08:52 2022] GET /identity/v3/projects/eef7c79d7cc64aec9dd4549226048f7b => generated 312 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:53.183906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4ce71-1da3-40d8-844f-8a95a2888d3b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:53.297605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968cea8-cf44-4359-a479-c4ce46ac674a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:53.373700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5dc84-7359-44c0-ba1f-80ecfafe0d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:53.374328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5dc84-7359-44c0-ba1f-80ecfafe0d82 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:53.374616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5dc84-7359-44c0-ba1f-80ecfafe0d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:53.374897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5dc84-7359-44c0-ba1f-80ecfafe0d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:53.376191 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5dc84-7359-44c0-ba1f-80ecfafe0d82 None admin] RBAC: Adding query filter params (role.id=b6a39390284c4cef8e11ad0888016b38, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64, user.id=66691c32d587443cb7787f9e28a6a013) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:53.376507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5dc84-7359-44c0-ba1f-80ecfafe0d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:53.378382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5dc84-7359-44c0-ba1f-80ecfafe0d82 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:53.391034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 45/96] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:08:53 2022] GET /identity/v3/role_assignments?user.id=66691c32d587443cb7787f9e28a6a013&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:08:53.415386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4ce71-1da3-40d8-844f-8a95a2888d3b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:53.454012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:53.477982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92742705-0b29-417d-8bcc-d4e9ae2d8b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:53.478620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92742705-0b29-417d-8bcc-d4e9ae2d8b11 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:53.478900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92742705-0b29-417d-8bcc-d4e9ae2d8b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:53.479174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92742705-0b29-417d-8bcc-d4e9ae2d8b11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:53.479959 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92742705-0b29-417d-8bcc-d4e9ae2d8b11 None admin] RBAC: Adding query filter params (role.id=b6a39390284c4cef8e11ad0888016b38, scope.project.id=eef7c79d7cc64aec9dd4549226048f7b, user.id=66691c32d587443cb7787f9e28a6a013) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:53.480266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92742705-0b29-417d-8bcc-d4e9ae2d8b11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:53.482090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92742705-0b29-417d-8bcc-d4e9ae2d8b11 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:53.491972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 52/97] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:08:53 2022] GET /identity/v3/role_assignments?user.id=66691c32d587443cb7787f9e28a6a013&scope.project.id=eef7c79d7cc64aec9dd4549226048f7b&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:08:55.139841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd8a9-f27e-400b-a61b-2caaf86fc4c7 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:55.140399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd8a9-f27e-400b-a61b-2caaf86fc4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:55.140399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd8a9-f27e-400b-a61b-2caaf86fc4c7 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:55.142151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 46/98] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:55.147358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d5368-e472-4ff4-9db9-f2026a225531 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:55.147745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d5368-e472-4ff4-9db9-f2026a225531 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:55.147906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d5368-e472-4ff4-9db9-f2026a225531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:55.170829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6f3d5368-e472-4ff4-9db9-f2026a225531 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:55.172058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6f3d5368-e472-4ff4-9db9-f2026a225531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:55.255285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 53/99] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:55.558571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab69b8-1e14-4a99-a986-01e3e5ad97fd None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:55.558757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab69b8-1e14-4a99-a986-01e3e5ad97fd None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:55.559030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab69b8-1e14-4a99-a986-01e3e5ad97fd None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:55.561116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 47/100] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:55.567329 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5b641-223e-47f0-ab85-d7b10dc1c12f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:55.567798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5b641-223e-47f0-ab85-d7b10dc1c12f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:55.568242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5b641-223e-47f0-ab85-d7b10dc1c12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:55.588976 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5cb5b641-223e-47f0-ab85-d7b10dc1c12f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:55.590469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5cb5b641-223e-47f0-ab85-d7b10dc1c12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:55.634016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8a53b-6173-4dd7-a8d4-f1054e2a4fa9 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:55.634655 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8a53b-6173-4dd7-a8d4-f1054e2a4fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:55.635160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8a53b-6173-4dd7-a8d4-f1054e2a4fa9 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:55.638096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 48/101] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:55.643040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81350b0-466f-4edc-9a6a-e488610e9309 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:55.643918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81350b0-466f-4edc-9a6a-e488610e9309 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:55.644492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81350b0-466f-4edc-9a6a-e488610e9309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:55.671692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b81350b0-466f-4edc-9a6a-e488610e9309 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:55.673288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b81350b0-466f-4edc-9a6a-e488610e9309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:55.704190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 54/102] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:08:55.755637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:55.785194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 49/103] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:08:55.807026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5b641-223e-47f0-ab85-d7b10dc1c12f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:55.881299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:55.955341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5b641-223e-47f0-ab85-d7b10dc1c12f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:55.976571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe698a8-6959-4b3b-89d9-9661e7f5eb27 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:55.977186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe698a8-6959-4b3b-89d9-9661e7f5eb27 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:55.977649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe698a8-6959-4b3b-89d9-9661e7f5eb27 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:55.979433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 50/104] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:55.985001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5f82e-0a2e-49b7-8a7e-b935a0d2f09f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:55.985507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5f82e-0a2e-49b7-8a7e-b935a0d2f09f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:55.985962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5f82e-0a2e-49b7-8a7e-b935a0d2f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.004956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-36a5f82e-0a2e-49b7-8a7e-b935a0d2f09f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:56.006214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b414d-e3f3-437f-bc0e-e95e84dca0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:56.006702 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-36a5f82e-0a2e-49b7-8a7e-b935a0d2f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:56.006966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b414d-e3f3-437f-bc0e-e95e84dca0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.007287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b414d-e3f3-437f-bc0e-e95e84dca0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.007558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b414d-e3f3-437f-bc0e-e95e84dca0d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.018257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b414d-e3f3-437f-bc0e-e95e84dca0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e86b414d-e3f3-437f-bc0e-e95e84dca0d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:56.024045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:56.024872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:08:56.025623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:08:56.028132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 55/105] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:08:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:56.034899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b414d-e3f3-437f-bc0e-e95e84dca0d2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:56.122060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 51/106] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:56.141170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b414d-e3f3-437f-bc0e-e95e84dca0d2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:56.144168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:56.180077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d102276-b76d-4b70-9e04-c586da3047b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:56.180684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d102276-b76d-4b70-9e04-c586da3047b4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.181146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d102276-b76d-4b70-9e04-c586da3047b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.181544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d102276-b76d-4b70-9e04-c586da3047b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.182344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d102276-b76d-4b70-9e04-c586da3047b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:56.182761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d102276-b76d-4b70-9e04-c586da3047b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:56.184336 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d102276-b76d-4b70-9e04-c586da3047b4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:56.193925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 56/107] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:08:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:08:56.196768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5f82e-0a2e-49b7-8a7e-b935a0d2f09f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:56.200293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d102276-b76d-4b70-9e04-c586da3047b4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:56.349726 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5f82e-0a2e-49b7-8a7e-b935a0d2f09f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:56.358945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:56.369186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d102276-b76d-4b70-9e04-c586da3047b4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:56.393293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac563893-8889-4ec8-8db7-a0d970737f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:56.394343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac563893-8889-4ec8-8db7-a0d970737f40 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.394774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac563893-8889-4ec8-8db7-a0d970737f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.395051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac563893-8889-4ec8-8db7-a0d970737f40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.404776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cb61d-2e84-484a-bb15-aefab558b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:56.405654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cb61d-2e84-484a-bb15-aefab558b699 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.405961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac563893-8889-4ec8-8db7-a0d970737f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:56.406159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cb61d-2e84-484a-bb15-aefab558b699 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.406598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cb61d-2e84-484a-bb15-aefab558b699 None admin] PATH_INFO: `/v3/users/c9217d49f4d544b29aa65b7138832607` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-ac563893-8889-4ec8-8db7-a0d970737f40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:56.411283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:56.412171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:08:56.412921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 52/108] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:08:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:56.413529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac563893-8889-4ec8-8db7-a0d970737f40 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:56.423475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cb61d-2e84-484a-bb15-aefab558b699 None admin] RBAC: Authorizing `identity:get_user(user_id=c9217d49f4d544b29aa65b7138832607)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:56.425520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cb61d-2e84-484a-bb15-aefab558b699 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:56.427534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 57/109] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:56 2022] GET /identity/v3/users/c9217d49f4d544b29aa65b7138832607 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:56.428926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d16f-4596-4da3-a8ac-1916eeede6a9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.429206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d16f-4596-4da3-a8ac-1916eeede6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.429474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d16f-4596-4da3-a8ac-1916eeede6a9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.430834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 58/110] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:56.435550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8d16f-4596-4da3-a8ac-1916eeede6a9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:56.463008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:56.518334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac563893-8889-4ec8-8db7-a0d970737f40 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:56.541252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8d16f-4596-4da3-a8ac-1916eeede6a9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:56.551026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3192-8cb7-423a-b5fe-4f552620e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:56.551693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3192-8cb7-423a-b5fe-4f552620e30d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.551965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3192-8cb7-423a-b5fe-4f552620e30d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.552248 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3192-8cb7-423a-b5fe-4f552620e30d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.553355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb3192-8cb7-423a-b5fe-4f552620e30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:56.554823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb3192-8cb7-423a-b5fe-4f552620e30d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:56.556433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 53/111] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:56.557195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3192-8cb7-423a-b5fe-4f552620e30d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:56.577860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8609ff-d1b6-427b-b428-8a218bb8c4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:56.578568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8609ff-d1b6-427b-b428-8a218bb8c4fb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.578845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8609ff-d1b6-427b-b428-8a218bb8c4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.579114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8609ff-d1b6-427b-b428-8a218bb8c4fb None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.579808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8609ff-d1b6-427b-b428-8a218bb8c4fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:56.580106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8609ff-d1b6-427b-b428-8a218bb8c4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:56.581538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8609ff-d1b6-427b-b428-8a218bb8c4fb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:56.589333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 59/112] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:08:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:56.590511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:56.590630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab849f-3339-479a-9422-5ff154244b24 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.590886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab849f-3339-479a-9422-5ff154244b24 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.591164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab849f-3339-479a-9422-5ff154244b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.609731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-67ab849f-3339-479a-9422-5ff154244b24 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:56.610957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-67ab849f-3339-479a-9422-5ff154244b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:56.658873 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3192-8cb7-423a-b5fe-4f552620e30d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:56.677689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 60/113] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:56.678544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab849f-3339-479a-9422-5ff154244b24 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:56.696645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0ec03-885c-41a8-a6eb-552c7857b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:56.696824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:56.697249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0ec03-885c-41a8-a6eb-552c7857b6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.697731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0ec03-885c-41a8-a6eb-552c7857b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.697983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0ec03-885c-41a8-a6eb-552c7857b6c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.708825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0ec03-885c-41a8-a6eb-552c7857b6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-dfb0ec03-885c-41a8-a6eb-552c7857b6c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:56.714126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:56.714956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:08:56.715745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 54/114] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:08:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:56.716954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f22ab-efb2-4e7c-87a4-22505fe0362d None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.717156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f22ab-efb2-4e7c-87a4-22505fe0362d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.717452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f22ab-efb2-4e7c-87a4-22505fe0362d None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.718681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 55/115] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:56.721543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f22ab-efb2-4e7c-87a4-22505fe0362d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:56.786103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab849f-3339-479a-9422-5ff154244b24 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:56.823672 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:56.827269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c329b78-7a37-4e62-ba66-b403ade0cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:56.827913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c329b78-7a37-4e62-ba66-b403ade0cf80 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.828200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c329b78-7a37-4e62-ba66-b403ade0cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.828479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c329b78-7a37-4e62-ba66-b403ade0cf80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.832096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f22ab-efb2-4e7c-87a4-22505fe0362d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:56.876067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e080ed-8568-4480-86dc-647af4536736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:56.876681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e080ed-8568-4480-86dc-647af4536736 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:56.876962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e080ed-8568-4480-86dc-647af4536736 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:56.877382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e080ed-8568-4480-86dc-647af4536736 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:56.878089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e080ed-8568-4480-86dc-647af4536736 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:56.879590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e080ed-8568-4480-86dc-647af4536736 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:56.919371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 56/116] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:08:56 2022] POST /identity/v3/projects => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:08:56.919371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e080ed-8568-4480-86dc-647af4536736 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:56.919629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c329b78-7a37-4e62-ba66-b403ade0cf80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:56.919629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c329b78-7a37-4e62-ba66-b403ade0cf80 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:56.950559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:57.040406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 61/117] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:08:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:08:57.041284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c329b78-7a37-4e62-ba66-b403ade0cf80 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.053153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e080ed-8568-4480-86dc-647af4536736 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:57.097157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea9806-0bba-43f4-be06-33c6e5f5cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:57.098100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea9806-0bba-43f4-be06-33c6e5f5cfde None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.098546 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea9806-0bba-43f4-be06-33c6e5f5cfde None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.099020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea9806-0bba-43f4-be06-33c6e5f5cfde None admin] PATH_INFO: `/v3/users/f6ea32dae1644e03acb20487dc4a95a0` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.100293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea9806-0bba-43f4-be06-33c6e5f5cfde None admin] RBAC: Authorizing `identity:get_user(user_id=f6ea32dae1644e03acb20487dc4a95a0)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:57.101761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea9806-0bba-43f4-be06-33c6e5f5cfde None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:57.103640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 57/118] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:56 2022] GET /identity/v3/users/f6ea32dae1644e03acb20487dc4a95a0 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:57.109030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db66ea-fe9c-475e-93fe-ad6993b1e3ec None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.109331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db66ea-fe9c-475e-93fe-ad6993b1e3ec None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.109886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db66ea-fe9c-475e-93fe-ad6993b1e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.130210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-c1db66ea-fe9c-475e-93fe-ad6993b1e3ec None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:57.131635 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c1db66ea-fe9c-475e-93fe-ad6993b1e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:57.142315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:57.154960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c329b78-7a37-4e62-ba66-b403ade0cf80 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:57.172925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:57.198313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef59aa-b0b1-403f-b549-38cbe7bba109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:57.199008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef59aa-b0b1-403f-b549-38cbe7bba109 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.199234 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef59aa-b0b1-403f-b549-38cbe7bba109 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.199534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef59aa-b0b1-403f-b549-38cbe7bba109 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.200208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef59aa-b0b1-403f-b549-38cbe7bba109 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:57.200507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef59aa-b0b1-403f-b549-38cbe7bba109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:57.201881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef59aa-b0b1-403f-b549-38cbe7bba109 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:57.210346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 62/119] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:08:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:57.212194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef59aa-b0b1-403f-b549-38cbe7bba109 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.212496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 58/120] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:08:57.213882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db66ea-fe9c-475e-93fe-ad6993b1e3ec None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.334808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef59aa-b0b1-403f-b549-38cbe7bba109 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:57.342243 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db66ea-fe9c-475e-93fe-ad6993b1e3ec None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:57.370666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5cea2-ccae-45e2-8f0c-a2efd2979540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:57.371370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5cea2-ccae-45e2-8f0c-a2efd2979540 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.371642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5cea2-ccae-45e2-8f0c-a2efd2979540 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.371915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5cea2-ccae-45e2-8f0c-a2efd2979540 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.382835 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5cea2-ccae-45e2-8f0c-a2efd2979540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:57.386606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddd60f-d9ac-4017-a0c2-f6b620579376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:57.387496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddd60f-d9ac-4017-a0c2-f6b620579376 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.387982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddd60f-d9ac-4017-a0c2-f6b620579376 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-33f5cea2-ccae-45e2-8f0c-a2efd2979540 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:57.388426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:57.389247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 63/121] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:08:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:57.395123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5cea2-ccae-45e2-8f0c-a2efd2979540 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.397053 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddd60f-d9ac-4017-a0c2-f6b620579376 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.398846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddd60f-d9ac-4017-a0c2-f6b620579376 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:57.400568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddd60f-d9ac-4017-a0c2-f6b620579376 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:57.403005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 59/122] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:08:57 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:57.408779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddd60f-d9ac-4017-a0c2-f6b620579376 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.429393 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:57.440538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:57.519399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5cea2-ccae-45e2-8f0c-a2efd2979540 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:57.533100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddd60f-d9ac-4017-a0c2-f6b620579376 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:57.557478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9de192-9ea5-4e05-b655-02f617a0a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:57.558476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9de192-9ea5-4e05-b655-02f617a0a2ae None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.558946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9de192-9ea5-4e05-b655-02f617a0a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.559440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9de192-9ea5-4e05-b655-02f617a0a2ae None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.560703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9de192-9ea5-4e05-b655-02f617a0a2ae None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:57.562302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9de192-9ea5-4e05-b655-02f617a0a2ae None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:57.564097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 64/123] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:08:57 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:57.565149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9de192-9ea5-4e05-b655-02f617a0a2ae None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.571986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e358b0-0cdd-4594-a6ce-e3eb4c3effae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:57.572596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e358b0-0cdd-4594-a6ce-e3eb4c3effae None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.572885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e358b0-0cdd-4594-a6ce-e3eb4c3effae None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.573148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e358b0-0cdd-4594-a6ce-e3eb4c3effae None admin] PATH_INFO: `/v3/users/66691c32d587443cb7787f9e28a6a013` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.574272 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e358b0-0cdd-4594-a6ce-e3eb4c3effae None admin] RBAC: Authorizing `identity:get_user(user_id=66691c32d587443cb7787f9e28a6a013)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:57.575764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e358b0-0cdd-4594-a6ce-e3eb4c3effae None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:57.577366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 60/124] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:57 2022] GET /identity/v3/users/66691c32d587443cb7787f9e28a6a013 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:57.582934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e358b0-0cdd-4594-a6ce-e3eb4c3effae None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.663372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:57.670443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9de192-9ea5-4e05-b655-02f617a0a2ae None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:57.677612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:57.685169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e358b0-0cdd-4594-a6ce-e3eb4c3effae None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:57.707794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf9c03-87dc-4efc-956c-71b289b51aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:57.708412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf9c03-87dc-4efc-956c-71b289b51aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.708688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf9c03-87dc-4efc-956c-71b289b51aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.709104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf9c03-87dc-4efc-956c-71b289b51aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.709993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf9c03-87dc-4efc-956c-71b289b51aa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:57.710155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf9c03-87dc-4efc-956c-71b289b51aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:57.711504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf9c03-87dc-4efc-956c-71b289b51aa6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:57.725107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 65/125] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:08:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:57.725107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf9c03-87dc-4efc-956c-71b289b51aa6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.726264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e425c05-091f-478e-820b-467df6e8f68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:57.726888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e425c05-091f-478e-820b-467df6e8f68d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.727175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e425c05-091f-478e-820b-467df6e8f68d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.727486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e425c05-091f-478e-820b-467df6e8f68d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.728223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e425c05-091f-478e-820b-467df6e8f68d None admin] RBAC: Adding query filter params (role.id=aad7b5d260224bf496f850a91a555d72, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64, user.id=c9217d49f4d544b29aa65b7138832607) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:57.728537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e425c05-091f-478e-820b-467df6e8f68d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:57.729993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e425c05-091f-478e-820b-467df6e8f68d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:57.736181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 61/126] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:08:57 2022] GET /identity/v3/role_assignments?user.id=c9217d49f4d544b29aa65b7138832607&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=aad7b5d260224bf496f850a91a555d72 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:57.736181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e425c05-091f-478e-820b-467df6e8f68d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.849277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf9c03-87dc-4efc-956c-71b289b51aa6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:57.892889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f0737-b584-4fba-b623-e4d0ed98fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:57.893821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f0737-b584-4fba-b623-e4d0ed98fa3c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.894098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f0737-b584-4fba-b623-e4d0ed98fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.894364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f0737-b584-4fba-b623-e4d0ed98fa3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.894741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e425c05-091f-478e-820b-467df6e8f68d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:57.910908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f0737-b584-4fba-b623-e4d0ed98fa3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-243f0737-b584-4fba-b623-e4d0ed98fa3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:08:57.917559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:08:57.918404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:08:57.919158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 66/127] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:08:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:08:57.919851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f0737-b584-4fba-b623-e4d0ed98fa3c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.935946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6ceee-05d3-40ac-ab3e-bf2a16efc2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:57.936601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ceee-05d3-40ac-ab3e-bf2a16efc2d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:57.936892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ceee-05d3-40ac-ab3e-bf2a16efc2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:57.937289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ceee-05d3-40ac-ab3e-bf2a16efc2d0 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/users/f6ea32dae1644e03acb20487dc4a95a0/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:57.939370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6ceee-05d3-40ac-ab3e-bf2a16efc2d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd9ad6ae07d3434aac0240c2be74fd64, user_id=f6ea32dae1644e03acb20487dc4a95a0, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:57.941415 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6ceee-05d3-40ac-ab3e-bf2a16efc2d0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:57.952805 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:57.963340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 62/128] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:08:57 2022] PUT /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/users/f6ea32dae1644e03acb20487dc4a95a0/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:08:57.964389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6ceee-05d3-40ac-ab3e-bf2a16efc2d0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:57.969612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:58.109728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f0737-b584-4fba-b623-e4d0ed98fa3c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:58.163684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6ceee-05d3-40ac-ab3e-bf2a16efc2d0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:58.168835 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de726-0fdb-4a44-8e1a-91a1f424239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:58.169490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de726-0fdb-4a44-8e1a-91a1f424239f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:58.169776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de726-0fdb-4a44-8e1a-91a1f424239f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:58.170055 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de726-0fdb-4a44-8e1a-91a1f424239f None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:58.171376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de726-0fdb-4a44-8e1a-91a1f424239f None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:58.172851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de726-0fdb-4a44-8e1a-91a1f424239f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:58.175112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 67/129] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:08:57 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:58.178630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de726-0fdb-4a44-8e1a-91a1f424239f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:58.199380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e64bf-669e-4d67-8e34-58c12f84b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:58.199950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e64bf-669e-4d67-8e34-58c12f84b381 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:58.200229 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e64bf-669e-4d67-8e34-58c12f84b381 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:58.200500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e64bf-669e-4d67-8e34-58c12f84b381 None admin] PATH_INFO: `/v3/users/66691c32d587443cb7787f9e28a6a013` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:58.201629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e64bf-669e-4d67-8e34-58c12f84b381 None admin] RBAC: Authorizing `identity:get_user(user_id=66691c32d587443cb7787f9e28a6a013)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:58.203145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e64bf-669e-4d67-8e34-58c12f84b381 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:58.205083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 63/130] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:57 2022] GET /identity/v3/users/66691c32d587443cb7787f9e28a6a013 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:58.206301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e64bf-669e-4d67-8e34-58c12f84b381 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:58.283163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:58.289294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de726-0fdb-4a44-8e1a-91a1f424239f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:58.289849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:58.319045 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e64bf-669e-4d67-8e34-58c12f84b381 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:58.325405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69150e82-62a2-4391-96ef-64c615be7850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:58.326038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69150e82-62a2-4391-96ef-64c615be7850 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:58.326326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69150e82-62a2-4391-96ef-64c615be7850 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:58.326608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69150e82-62a2-4391-96ef-64c615be7850 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:58.327311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69150e82-62a2-4391-96ef-64c615be7850 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:08:58.327627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69150e82-62a2-4391-96ef-64c615be7850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:58.329034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69150e82-62a2-4391-96ef-64c615be7850 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:58.342249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 68/131] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:08:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:58.343177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69150e82-62a2-4391-96ef-64c615be7850 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:58.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22546372-74c8-4d75-9c51-ad7cdf3b0604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:58.361211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22546372-74c8-4d75-9c51-ad7cdf3b0604 None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:58.361497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22546372-74c8-4d75-9c51-ad7cdf3b0604 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:58.361843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22546372-74c8-4d75-9c51-ad7cdf3b0604 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/users/66691c32d587443cb7787f9e28a6a013/roles/4111136d5e114c4b9ca719aa39f4bc23` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:58.364726 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22546372-74c8-4d75-9c51-ad7cdf3b0604 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd9ad6ae07d3434aac0240c2be74fd64, user_id=66691c32d587443cb7787f9e28a6a013, role_id=4111136d5e114c4b9ca719aa39f4bc23)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:58.366712 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22546372-74c8-4d75-9c51-ad7cdf3b0604 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:58.401639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 64/132] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:08:58 2022] PUT /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/users/66691c32d587443cb7787f9e28a6a013/roles/4111136d5e114c4b9ca719aa39f4bc23 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:08:58.402497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22546372-74c8-4d75-9c51-ad7cdf3b0604 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:58.469400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69150e82-62a2-4391-96ef-64c615be7850 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:58.506569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad7c37-9eab-451b-a4e4-be361522995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:58.507224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad7c37-9eab-451b-a4e4-be361522995f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:58.507543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad7c37-9eab-451b-a4e4-be361522995f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:58.507816 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad7c37-9eab-451b-a4e4-be361522995f None admin] PATH_INFO: `/v3/projects/eef7c79d7cc64aec9dd4549226048f7b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:58.513982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad7c37-9eab-451b-a4e4-be361522995f None admin] RBAC: Authorizing `identity:get_project(project_id=eef7c79d7cc64aec9dd4549226048f7b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:58.515509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad7c37-9eab-451b-a4e4-be361522995f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:58.517435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 69/133] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:08:58 2022] GET /identity/v3/projects/eef7c79d7cc64aec9dd4549226048f7b => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:58.528017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad7c37-9eab-451b-a4e4-be361522995f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:58.584346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:58.638561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22546372-74c8-4d75-9c51-ad7cdf3b0604 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:58.671854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:58.678303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f285df0-c9ac-4dde-9f65-0674f50bd0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:58.678964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285df0-c9ac-4dde-9f65-0674f50bd0fb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:58.679269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285df0-c9ac-4dde-9f65-0674f50bd0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:58.679554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285df0-c9ac-4dde-9f65-0674f50bd0fb None admin] PATH_INFO: `/v3/users/66691c32d587443cb7787f9e28a6a013` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:58.680986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f285df0-c9ac-4dde-9f65-0674f50bd0fb None admin] RBAC: Authorizing `identity:get_user(user_id=66691c32d587443cb7787f9e28a6a013)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:58.682471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f285df0-c9ac-4dde-9f65-0674f50bd0fb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:58.684311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 65/134] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:08:58 2022] GET /identity/v3/users/66691c32d587443cb7787f9e28a6a013 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:58.692456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f285df0-c9ac-4dde-9f65-0674f50bd0fb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:58.743011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad7c37-9eab-451b-a4e4-be361522995f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:58.809576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52f560-7e6f-4aa0-90fa-85568113c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:58.810355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f560-7e6f-4aa0-90fa-85568113c642 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:58.810634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f560-7e6f-4aa0-90fa-85568113c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:58.810907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f560-7e6f-4aa0-90fa-85568113c642 None admin] PATH_INFO: `/v3/projects/eef7c79d7cc64aec9dd4549226048f7b/users/66691c32d587443cb7787f9e28a6a013/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:58.813193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52f560-7e6f-4aa0-90fa-85568113c642 None admin] RBAC: Authorizing `identity:create_grant(project_id=eef7c79d7cc64aec9dd4549226048f7b, user_id=66691c32d587443cb7787f9e28a6a013, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:58.814772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52f560-7e6f-4aa0-90fa-85568113c642 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:58.829860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f285df0-c9ac-4dde-9f65-0674f50bd0fb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:58.841587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 70/135] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:08:58 2022] PUT /identity/v3/projects/eef7c79d7cc64aec9dd4549226048f7b/users/66691c32d587443cb7787f9e28a6a013/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:08:58.870254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b4104-cbbd-434b-b0b7-7b12f932740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:58.870920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4104-cbbd-434b-b0b7-7b12f932740e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:58.871204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4104-cbbd-434b-b0b7-7b12f932740e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:58.871530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4104-cbbd-434b-b0b7-7b12f932740e None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:58.872755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b4104-cbbd-434b-b0b7-7b12f932740e None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:58.874279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b4104-cbbd-434b-b0b7-7b12f932740e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:58.876090 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 66/136] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:08:58 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:58.882774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52f560-7e6f-4aa0-90fa-85568113c642 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:59.020582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:59.039076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52f560-7e6f-4aa0-90fa-85568113c642 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:59.082806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602af10-483b-471f-895c-2d093dd1c9ed None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:59.083182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602af10-483b-471f-895c-2d093dd1c9ed None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:59.083437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602af10-483b-471f-895c-2d093dd1c9ed None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:59.085098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 67/137] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:08:59.090698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554b6bb-417d-4ba6-93b4-07c72135f3b3 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:59.090985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554b6bb-417d-4ba6-93b4-07c72135f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:59.091277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554b6bb-417d-4ba6-93b4-07c72135f3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:59.096951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96380-5171-4135-b569-81a94b5d08e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:59.097783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96380-5171-4135-b569-81a94b5d08e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:59.098072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96380-5171-4135-b569-81a94b5d08e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:59.098350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96380-5171-4135-b569-81a94b5d08e7 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/users/66691c32d587443cb7787f9e28a6a013/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:59.104830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96380-5171-4135-b569-81a94b5d08e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd9ad6ae07d3434aac0240c2be74fd64, user_id=66691c32d587443cb7787f9e28a6a013, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:59.106667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96380-5171-4135-b569-81a94b5d08e7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:59.111068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4554b6bb-417d-4ba6-93b4-07c72135f3b3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:08:59.112683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4554b6bb-417d-4ba6-93b4-07c72135f3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:08:59.133957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 71/138] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:08:58 2022] PUT /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/users/66691c32d587443cb7787f9e28a6a013/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:08:59.187902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:08:59.199231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 68/139] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:08:59.481597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96380-5171-4135-b569-81a94b5d08e7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:59.606431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96380-5171-4135-b569-81a94b5d08e7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:59.648217 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8ccea-d1da-4d17-affc-b56670e7ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:59.648870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8ccea-d1da-4d17-affc-b56670e7ca8b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:59.649201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8ccea-d1da-4d17-affc-b56670e7ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:59.649486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8ccea-d1da-4d17-affc-b56670e7ca8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:59.652246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8ccea-d1da-4d17-affc-b56670e7ca8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:59.653780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8ccea-d1da-4d17-affc-b56670e7ca8b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:59.655414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 72/140] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:08:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:08:59.661307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554b6bb-417d-4ba6-93b4-07c72135f3b3 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:08:59.789109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554b6bb-417d-4ba6-93b4-07c72135f3b3 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:08:59.836886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f6a7f-5c47-4294-b342-89906ed5c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:08:59.837511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f6a7f-5c47-4294-b342-89906ed5c08e None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:08:59.837795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f6a7f-5c47-4294-b342-89906ed5c08e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:08:59.838071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f6a7f-5c47-4294-b342-89906ed5c08e None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:08:59.838745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f6a7f-5c47-4294-b342-89906ed5c08e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:08:59.840256 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f6a7f-5c47-4294-b342-89906ed5c08e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:08:59.876589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 69/141] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:08:59 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:09:00.083756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eefd0-7ffc-4f44-8ba6-529a09a74d8b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:00.084129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eefd0-7ffc-4f44-8ba6-529a09a74d8b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:00.084345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eefd0-7ffc-4f44-8ba6-529a09a74d8b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:00.085715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 73/142] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:00.101376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69db3-2ab6-4b08-9fe0-04cb311e8a3e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:00.101673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69db3-2ab6-4b08-9fe0-04cb311e8a3e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:00.101930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69db3-2ab6-4b08-9fe0-04cb311e8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:00.132456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-07c69db3-2ab6-4b08-9fe0-04cb311e8a3e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:00.133719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-07c69db3-2ab6-4b08-9fe0-04cb311e8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:00.199286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:00.218675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 70/143] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:00.741737 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eefd0-7ffc-4f44-8ba6-529a09a74d8b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:00.765146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:00.886299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eefd0-7ffc-4f44-8ba6-529a09a74d8b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:00.928065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d608b-cd56-44cf-b561-ed17609c95e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:00.928712 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d608b-cd56-44cf-b561-ed17609c95e0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:00.928993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d608b-cd56-44cf-b561-ed17609c95e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:00.929265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d608b-cd56-44cf-b561-ed17609c95e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:00.941668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d608b-cd56-44cf-b561-ed17609c95e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-799d608b-cd56-44cf-b561-ed17609c95e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:00.946566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:00.947413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:00.948173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 74/144] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:00.954915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69db3-2ab6-4b08-9fe0-04cb311e8a3e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:01.091041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208947-1c89-4980-8fee-d4fa919ec548 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.091401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208947-1c89-4980-8fee-d4fa919ec548 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.091630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208947-1c89-4980-8fee-d4fa919ec548 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.092985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 75/145] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:09:01.099278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161325a1-8cb1-4405-b388-2a955f706c45 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.099597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161325a1-8cb1-4405-b388-2a955f706c45 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.099857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161325a1-8cb1-4405-b388-2a955f706c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.109992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69db3-2ab6-4b08-9fe0-04cb311e8a3e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:01.120286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-161325a1-8cb1-4405-b388-2a955f706c45 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:01.121479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-161325a1-8cb1-4405-b388-2a955f706c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:01.161498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094218d7-eb36-4389-bf6f-38e04f6c9783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:01.162135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094218d7-eb36-4389-bf6f-38e04f6c9783 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.162440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094218d7-eb36-4389-bf6f-38e04f6c9783 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.162716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094218d7-eb36-4389-bf6f-38e04f6c9783 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.163483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094218d7-eb36-4389-bf6f-38e04f6c9783 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:01.163794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094218d7-eb36-4389-bf6f-38e04f6c9783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:01.165193 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094218d7-eb36-4389-bf6f-38e04f6c9783 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:01.185334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 71/146] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:01.195923 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094218d7-eb36-4389-bf6f-38e04f6c9783 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:01.197950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 76/147] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:01.279416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:01.347208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094218d7-eb36-4389-bf6f-38e04f6c9783 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:01.384301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432e875-8acb-4a62-8b69-1cf6a73bee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:01.384935 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432e875-8acb-4a62-8b69-1cf6a73bee39 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.385212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432e875-8acb-4a62-8b69-1cf6a73bee39 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.385479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432e875-8acb-4a62-8b69-1cf6a73bee39 None admin] PATH_INFO: `/v3/users/c9217d49f4d544b29aa65b7138832607` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.388985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432e875-8acb-4a62-8b69-1cf6a73bee39 None admin] RBAC: Authorizing `identity:get_user(user_id=c9217d49f4d544b29aa65b7138832607)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:01.390453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432e875-8acb-4a62-8b69-1cf6a73bee39 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:01.392317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 72/148] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:01 2022] GET /identity/v3/users/c9217d49f4d544b29aa65b7138832607 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:01.397827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161325a1-8cb1-4405-b388-2a955f706c45 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:01.402731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:01.407681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba0b7-0900-4916-b64a-9b27785c7c06 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.407681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba0b7-0900-4916-b64a-9b27785c7c06 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.408062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba0b7-0900-4916-b64a-9b27785c7c06 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.409830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 73/149] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:01.415032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d408a-d933-4bd3-9e05-8adfcd37a55b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.415393 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d408a-d933-4bd3-9e05-8adfcd37a55b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.415669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d408a-d933-4bd3-9e05-8adfcd37a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.444294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7d8d408a-d933-4bd3-9e05-8adfcd37a55b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:01.445479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7d8d408a-d933-4bd3-9e05-8adfcd37a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:01.556250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161325a1-8cb1-4405-b388-2a955f706c45 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:01.590987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 74/150] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:01.606990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e3069-5b6f-4f3f-8b9b-34368cafb767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:01.607962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3069-5b6f-4f3f-8b9b-34368cafb767 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.608447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3069-5b6f-4f3f-8b9b-34368cafb767 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.608902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3069-5b6f-4f3f-8b9b-34368cafb767 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.616032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e3069-5b6f-4f3f-8b9b-34368cafb767 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:01.617772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e3069-5b6f-4f3f-8b9b-34368cafb767 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:01.620053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 77/151] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:01 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:01.626099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d408a-d933-4bd3-9e05-8adfcd37a55b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:01.651643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e3069-5b6f-4f3f-8b9b-34368cafb767 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:01.692351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:01.749038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:01.775909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e3069-5b6f-4f3f-8b9b-34368cafb767 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:01.813236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94b7a8-44ef-4fbe-8039-a9be70d63dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:01.814332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94b7a8-44ef-4fbe-8039-a9be70d63dff None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.814838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94b7a8-44ef-4fbe-8039-a9be70d63dff None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.815366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94b7a8-44ef-4fbe-8039-a9be70d63dff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.818072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d408a-d933-4bd3-9e05-8adfcd37a55b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:01.827118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94b7a8-44ef-4fbe-8039-a9be70d63dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-de94b7a8-44ef-4fbe-8039-a9be70d63dff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:01.834065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:01.835138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:01.836152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 78/152] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:01.840591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94b7a8-44ef-4fbe-8039-a9be70d63dff None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:01.897452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1fbd1-64f8-44ae-84cd-5d27c347605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:01.898497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1fbd1-64f8-44ae-84cd-5d27c347605c None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.898970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1fbd1-64f8-44ae-84cd-5d27c347605c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.899460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1fbd1-64f8-44ae-84cd-5d27c347605c None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/users/c9217d49f4d544b29aa65b7138832607/roles/aad7b5d260224bf496f850a91a555d72` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.904744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1fbd1-64f8-44ae-84cd-5d27c347605c None admin] RBAC: Authorizing `identity:create_grant(project_id=dd9ad6ae07d3434aac0240c2be74fd64, user_id=c9217d49f4d544b29aa65b7138832607, role_id=aad7b5d260224bf496f850a91a555d72)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:01.906445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1fbd1-64f8-44ae-84cd-5d27c347605c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:01.943204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 75/153] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:09:01 2022] PUT /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/users/c9217d49f4d544b29aa65b7138832607/roles/aad7b5d260224bf496f850a91a555d72 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:01.945265 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396bba-e589-452b-8370-5b784875ebe1 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.946820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396bba-e589-452b-8370-5b784875ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.947119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396bba-e589-452b-8370-5b784875ebe1 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.949598 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 76/154] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:01.955640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65225c0-f5ce-464b-b3e6-1841c244c869 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:01.956281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94b7a8-44ef-4fbe-8039-a9be70d63dff None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:01.956835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65225c0-f5ce-464b-b3e6-1841c244c869 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:01.957330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65225c0-f5ce-464b-b3e6-1841c244c869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:01.978744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b65225c0-f5ce-464b-b3e6-1841c244c869 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:01.980393 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b65225c0-f5ce-464b-b3e6-1841c244c869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:02.008530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:02.017089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09eb098-7b20-4f40-93f2-859b1ba4cb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:02.018296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eb098-7b20-4f40-93f2-859b1ba4cb2a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:02.019918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eb098-7b20-4f40-93f2-859b1ba4cb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:02.020454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eb098-7b20-4f40-93f2-859b1ba4cb2a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:02.022321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09eb098-7b20-4f40-93f2-859b1ba4cb2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:02.023400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09eb098-7b20-4f40-93f2-859b1ba4cb2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:02.025237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09eb098-7b20-4f40-93f2-859b1ba4cb2a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:02.046854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 79/155] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:02.055153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09eb098-7b20-4f40-93f2-859b1ba4cb2a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:02.083141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 77/156] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:02.242133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09eb098-7b20-4f40-93f2-859b1ba4cb2a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:02.289284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c963c9-62c1-48bd-8bfa-a15274b32d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:02.289942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c963c9-62c1-48bd-8bfa-a15274b32d3b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:02.290213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c963c9-62c1-48bd-8bfa-a15274b32d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:02.290484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c963c9-62c1-48bd-8bfa-a15274b32d3b None admin] PATH_INFO: `/v3/users/66691c32d587443cb7787f9e28a6a013` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:02.291681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c963c9-62c1-48bd-8bfa-a15274b32d3b None admin] RBAC: Authorizing `identity:get_user(user_id=66691c32d587443cb7787f9e28a6a013)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:02.293153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c963c9-62c1-48bd-8bfa-a15274b32d3b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:02.294798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 80/157] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:02 2022] GET /identity/v3/users/66691c32d587443cb7787f9e28a6a013 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:02.300918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65225c0-f5ce-464b-b3e6-1841c244c869 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:02.332019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c963c9-62c1-48bd-8bfa-a15274b32d3b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:02.360326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:02.441205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65225c0-f5ce-464b-b3e6-1841c244c869 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:02.458039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:02.490266 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69567c-2e99-439d-ae52-ac4bc3ab4019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:02.490896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69567c-2e99-439d-ae52-ac4bc3ab4019 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:02.491177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69567c-2e99-439d-ae52-ac4bc3ab4019 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:02.491474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69567c-2e99-439d-ae52-ac4bc3ab4019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:02.549360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c963c9-62c1-48bd-8bfa-a15274b32d3b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:02.591741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69567c-2e99-439d-ae52-ac4bc3ab4019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:02.593979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69567c-2e99-439d-ae52-ac4bc3ab4019 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:02.652446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:02.656046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ee895-d19c-4beb-84cd-827a6371d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:02.656747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee895-d19c-4beb-84cd-827a6371d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:02.657104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee895-d19c-4beb-84cd-827a6371d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:02.657447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee895-d19c-4beb-84cd-827a6371d2d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:02.688305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ee895-d19c-4beb-84cd-827a6371d2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0e1ee895-d19c-4beb-84cd-827a6371d2d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:02.695204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:02.696138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:02.696888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:02.702972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 81/158] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:02.704070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ee895-d19c-4beb-84cd-827a6371d2d0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:02.774341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 78/159] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:02.775289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69567c-2e99-439d-ae52-ac4bc3ab4019 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:02.885484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69567c-2e99-439d-ae52-ac4bc3ab4019 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:02.919796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68e12a-b621-4e1d-add0-20f929eff065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:02.920432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68e12a-b621-4e1d-add0-20f929eff065 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:02.920710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68e12a-b621-4e1d-add0-20f929eff065 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:02.920980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68e12a-b621-4e1d-add0-20f929eff065 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:02.922473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68e12a-b621-4e1d-add0-20f929eff065 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:02.923601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68e12a-b621-4e1d-add0-20f929eff065 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:02.925863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 79/160] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:02 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:02.927057 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb698ef-9a05-4649-93f5-bb8c406f9bc3 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:02.927379 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb698ef-9a05-4649-93f5-bb8c406f9bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:02.927653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb698ef-9a05-4649-93f5-bb8c406f9bc3 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:02.929139 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 80/161] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:02.930121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb698ef-9a05-4649-93f5-bb8c406f9bc3 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:02.938918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:02.965523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ee895-d19c-4beb-84cd-827a6371d2d0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:03.026011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:03.071960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19974e6f-4293-4775-b237-b5712b446834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:03.072599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19974e6f-4293-4775-b237-b5712b446834 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:03.072881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19974e6f-4293-4775-b237-b5712b446834 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:03.073160 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19974e6f-4293-4775-b237-b5712b446834 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:03.073845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19974e6f-4293-4775-b237-b5712b446834 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:03.074148 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19974e6f-4293-4775-b237-b5712b446834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:03.075578 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19974e6f-4293-4775-b237-b5712b446834 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:03.090918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 82/162] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:03.091803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19974e6f-4293-4775-b237-b5712b446834 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:03.117466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb698ef-9a05-4649-93f5-bb8c406f9bc3 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:03.199292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991e301-fd2f-4f13-b49d-317ca3867243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:03.199292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991e301-fd2f-4f13-b49d-317ca3867243 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:03.199292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991e301-fd2f-4f13-b49d-317ca3867243 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:03.199292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991e301-fd2f-4f13-b49d-317ca3867243 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:03.224826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991e301-fd2f-4f13-b49d-317ca3867243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-0991e301-fd2f-4f13-b49d-317ca3867243 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:03.230896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:03.232142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:03.232893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 81/163] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:03.240159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710785f5-5a1d-4fd6-97d3-caa466950696 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:03.240460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710785f5-5a1d-4fd6-97d3-caa466950696 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:03.240733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710785f5-5a1d-4fd6-97d3-caa466950696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:03.276533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-710785f5-5a1d-4fd6-97d3-caa466950696 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:03.278012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-710785f5-5a1d-4fd6-97d3-caa466950696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:03.311360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19974e6f-4293-4775-b237-b5712b446834 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:03.374945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26de98a-c9d1-4d50-8af9-f7721cef58dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:03.375615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26de98a-c9d1-4d50-8af9-f7721cef58dd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:03.375888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26de98a-c9d1-4d50-8af9-f7721cef58dd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:03.376151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26de98a-c9d1-4d50-8af9-f7721cef58dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:03.376900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26de98a-c9d1-4d50-8af9-f7721cef58dd None admin] RBAC: Adding query filter params (role.id=4111136d5e114c4b9ca719aa39f4bc23, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64, user.id=66691c32d587443cb7787f9e28a6a013) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:03.377347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26de98a-c9d1-4d50-8af9-f7721cef58dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:03.378951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26de98a-c9d1-4d50-8af9-f7721cef58dd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:03.393144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:03.396798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 83/164] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:03 2022] GET /identity/v3/role_assignments?user.id=66691c32d587443cb7787f9e28a6a013&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=4111136d5e114c4b9ca719aa39f4bc23 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:03.401266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26de98a-c9d1-4d50-8af9-f7721cef58dd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:03.429890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 82/165] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:03.430598 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710785f5-5a1d-4fd6-97d3-caa466950696 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:03.498820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:03.575602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26de98a-c9d1-4d50-8af9-f7721cef58dd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:03.631103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90482298-f1e1-4305-967d-2dea290ca801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:03.631915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90482298-f1e1-4305-967d-2dea290ca801 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:03.632172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90482298-f1e1-4305-967d-2dea290ca801 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:03.632442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90482298-f1e1-4305-967d-2dea290ca801 None admin] PATH_INFO: `/v3/users/f6ea32dae1644e03acb20487dc4a95a0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:03.636072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90482298-f1e1-4305-967d-2dea290ca801 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ea32dae1644e03acb20487dc4a95a0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:03.637670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90482298-f1e1-4305-967d-2dea290ca801 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:03.639548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 84/166] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:03 2022] GET /identity/v3/users/f6ea32dae1644e03acb20487dc4a95a0 => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:03.646309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90482298-f1e1-4305-967d-2dea290ca801 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:03.692927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710785f5-5a1d-4fd6-97d3-caa466950696 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:03.771437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90482298-f1e1-4305-967d-2dea290ca801 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:03.780915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0894e8-17ca-4d66-8b3e-1a1d2ca20e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:03.781551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0894e8-17ca-4d66-8b3e-1a1d2ca20e53 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:03.781888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0894e8-17ca-4d66-8b3e-1a1d2ca20e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:03.782171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0894e8-17ca-4d66-8b3e-1a1d2ca20e53 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:03.782856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0894e8-17ca-4d66-8b3e-1a1d2ca20e53 None admin] RBAC: Adding query filter params (name=member) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:03.783158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0894e8-17ca-4d66-8b3e-1a1d2ca20e53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:03.784647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0894e8-17ca-4d66-8b3e-1a1d2ca20e53 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:03.788770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:03.802715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 83/167] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:03.808635 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0894e8-17ca-4d66-8b3e-1a1d2ca20e53 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:03.809553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7e97c-0089-47bc-b014-092375873176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:03.810181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7e97c-0089-47bc-b014-092375873176 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:03.810459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7e97c-0089-47bc-b014-092375873176 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:03.810727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7e97c-0089-47bc-b014-092375873176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:03.940946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:03.958446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7e97c-0089-47bc-b014-092375873176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:03.959958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7e97c-0089-47bc-b014-092375873176 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:04.001286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0894e8-17ca-4d66-8b3e-1a1d2ca20e53 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:04.067303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf5b90-dd50-4dee-bd7b-8bbfa6cd9ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:04.068150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf5b90-dd50-4dee-bd7b-8bbfa6cd9ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:04.068425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf5b90-dd50-4dee-bd7b-8bbfa6cd9ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:04.068692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf5b90-dd50-4dee-bd7b-8bbfa6cd9ac5 None admin] PATH_INFO: `/v3/users/66691c32d587443cb7787f9e28a6a013` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:04.071109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf5b90-dd50-4dee-bd7b-8bbfa6cd9ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=66691c32d587443cb7787f9e28a6a013)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:04.072724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf5b90-dd50-4dee-bd7b-8bbfa6cd9ac5 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:04.074733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 84/168] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:03 2022] GET /identity/v3/users/66691c32d587443cb7787f9e28a6a013 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:04.082998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf5b90-dd50-4dee-bd7b-8bbfa6cd9ac5 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:04.168569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 85/169] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:09:04.169349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7e97c-0089-47bc-b014-092375873176 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:04.219617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:04.289855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf5b90-dd50-4dee-bd7b-8bbfa6cd9ac5 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:04.329205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:04.358056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d1bf2-2db3-4d50-8feb-e2301cf273d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:04.358691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d1bf2-2db3-4d50-8feb-e2301cf273d0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:04.358961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d1bf2-2db3-4d50-8feb-e2301cf273d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:04.359628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d1bf2-2db3-4d50-8feb-e2301cf273d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:04.437455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7e97c-0089-47bc-b014-092375873176 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:04.444423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d1bf2-2db3-4d50-8feb-e2301cf273d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:04.446190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d1bf2-2db3-4d50-8feb-e2301cf273d0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:04.533310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613db367-1862-4326-9122-2f4f7d1ef15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:04.533994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db367-1862-4326-9122-2f4f7d1ef15d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:04.534278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db367-1862-4326-9122-2f4f7d1ef15d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:04.534643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db367-1862-4326-9122-2f4f7d1ef15d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:04.555560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 85/170] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:09:04.556763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d1bf2-2db3-4d50-8feb-e2301cf273d0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:04.571938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613db367-1862-4326-9122-2f4f7d1ef15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-613db367-1862-4326-9122-2f4f7d1ef15d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:04.576899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:04.577803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:04.578690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 86/171] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:04.581727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1cc5d-b143-4ca8-a47a-5424e6a67f35 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:04.586794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1cc5d-b143-4ca8-a47a-5424e6a67f35 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:04.586794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1cc5d-b143-4ca8-a47a-5424e6a67f35 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:04.592203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:04.596508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 87/172] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:04 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:04.597597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1cc5d-b143-4ca8-a47a-5424e6a67f35 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:04.675616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d1bf2-2db3-4d50-8feb-e2301cf273d0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:04.715443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ed8d-0922-43f5-a573-43fb61dd5f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:04.716597 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ed8d-0922-43f5-a573-43fb61dd5f18 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:04.717548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ed8d-0922-43f5-a573-43fb61dd5f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:04.718024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ed8d-0922-43f5-a573-43fb61dd5f18 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:04.719612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ed8d-0922-43f5-a573-43fb61dd5f18 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:04.722323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ed8d-0922-43f5-a573-43fb61dd5f18 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:04.724553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 86/173] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:04 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:04.730077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ed8d-0922-43f5-a573-43fb61dd5f18 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:04.739615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:04.767990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1cc5d-b143-4ca8-a47a-5424e6a67f35 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:04.808992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7006818-09d4-4ef3-baa0-53a95cc21a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:04.810027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006818-09d4-4ef3-baa0-53a95cc21a80 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:04.810506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006818-09d4-4ef3-baa0-53a95cc21a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:04.810977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006818-09d4-4ef3-baa0-53a95cc21a80 None admin] PATH_INFO: `/v3/projects/eef7c79d7cc64aec9dd4549226048f7b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:04.812348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7006818-09d4-4ef3-baa0-53a95cc21a80 None admin] RBAC: Authorizing `identity:get_project(project_id=eef7c79d7cc64aec9dd4549226048f7b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:04.814005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7006818-09d4-4ef3-baa0-53a95cc21a80 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:04.815952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 88/174] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:04 2022] GET /identity/v3/projects/eef7c79d7cc64aec9dd4549226048f7b => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:04.821002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4bd69-3cdf-463e-afca-38e4ff9534aa None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:04.821002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4bd69-3cdf-463e-afca-38e4ff9534aa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:04.821002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4bd69-3cdf-463e-afca-38e4ff9534aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:04.826440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:04.836327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ed8d-0922-43f5-a573-43fb61dd5f18 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:04.840695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-40e4bd69-3cdf-463e-afca-38e4ff9534aa None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:04.841975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-40e4bd69-3cdf-463e-afca-38e4ff9534aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:04.871838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e3375-490d-4bf5-9a45-739c36c02114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:04.872564 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e3375-490d-4bf5-9a45-739c36c02114 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:04.872840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e3375-490d-4bf5-9a45-739c36c02114 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:04.873243 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e3375-490d-4bf5-9a45-739c36c02114 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:04.873884 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e3375-490d-4bf5-9a45-739c36c02114 None admin] RBAC: Adding query filter params (name=member) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:04.874187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e3375-490d-4bf5-9a45-739c36c02114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:04.875599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e3375-490d-4bf5-9a45-739c36c02114 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:04.891842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 87/175] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:04.891842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca90981-097b-4716-a337-65571444291a None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:04.891842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca90981-097b-4716-a337-65571444291a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:04.891842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca90981-097b-4716-a337-65571444291a None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:04.891842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 88/176] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:04.891842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca90981-097b-4716-a337-65571444291a None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:04.918114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 89/177] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:04.925795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8bcd4-ab6d-44b7-8f67-6448297ae568 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:04.925795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8bcd4-ab6d-44b7-8f67-6448297ae568 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:04.925795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8bcd4-ab6d-44b7-8f67-6448297ae568 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:04.925795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 90/178] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:04.927286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8bcd4-ab6d-44b7-8f67-6448297ae568 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:05.020843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca90981-097b-4716-a337-65571444291a None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:05.023480 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:05.050524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8bcd4-ab6d-44b7-8f67-6448297ae568 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:05.067351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0417c3-c7e1-428d-bd57-3ed99e4e6feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:05.068447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0417c3-c7e1-428d-bd57-3ed99e4e6feb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.068873 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0417c3-c7e1-428d-bd57-3ed99e4e6feb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.069590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0417c3-c7e1-428d-bd57-3ed99e4e6feb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.070462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0417c3-c7e1-428d-bd57-3ed99e4e6feb None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64, user.id=f6ea32dae1644e03acb20487dc4a95a0) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:05.070910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0417c3-c7e1-428d-bd57-3ed99e4e6feb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:05.073063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0417c3-c7e1-428d-bd57-3ed99e4e6feb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:05.082111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 89/179] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:04 2022] GET /identity/v3/role_assignments?user.id=f6ea32dae1644e03acb20487dc4a95a0&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:05.087724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0417c3-c7e1-428d-bd57-3ed99e4e6feb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:05.094689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395978a-4f78-47c2-9391-497f240129f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:05.095687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395978a-4f78-47c2-9391-497f240129f0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.096223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395978a-4f78-47c2-9391-497f240129f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.096752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395978a-4f78-47c2-9391-497f240129f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.097755 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395978a-4f78-47c2-9391-497f240129f0 None admin] RBAC: Adding query filter params (role.id=b6a39390284c4cef8e11ad0888016b38, scope.project.id=eef7c79d7cc64aec9dd4549226048f7b, user.id=66691c32d587443cb7787f9e28a6a013) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:05.098268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395978a-4f78-47c2-9391-497f240129f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:05.100529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395978a-4f78-47c2-9391-497f240129f0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:05.122237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 91/180] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:04 2022] GET /identity/v3/role_assignments?user.id=66691c32d587443cb7787f9e28a6a013&scope.project.id=eef7c79d7cc64aec9dd4549226048f7b&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:05.122890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:05.126150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585af535-154d-412d-a5b4-325a659dc952 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.126150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585af535-154d-412d-a5b4-325a659dc952 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.126150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585af535-154d-412d-a5b4-325a659dc952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.184432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-585af535-154d-412d-a5b4-325a659dc952 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:05.185664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-585af535-154d-412d-a5b4-325a659dc952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:05.297168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0417c3-c7e1-428d-bd57-3ed99e4e6feb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:05.313319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 92/181] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:05.315667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678ca1b-ae12-471a-ac96-98a2af3e9440 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.316053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678ca1b-ae12-471a-ac96-98a2af3e9440 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.316559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678ca1b-ae12-471a-ac96-98a2af3e9440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.340053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d678ca1b-ae12-471a-ac96-98a2af3e9440 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:05.341313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d678ca1b-ae12-471a-ac96-98a2af3e9440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:05.343707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb16af-8588-404d-8c92-1728041317b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:05.345511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb16af-8588-404d-8c92-1728041317b0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.346028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb16af-8588-404d-8c92-1728041317b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.346455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb16af-8588-404d-8c92-1728041317b0 None admin] PATH_INFO: `/v3/users/66691c32d587443cb7787f9e28a6a013` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.347853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb16af-8588-404d-8c92-1728041317b0 None admin] RBAC: Authorizing `identity:get_user(user_id=66691c32d587443cb7787f9e28a6a013)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:05.349640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb16af-8588-404d-8c92-1728041317b0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:05.352490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 90/182] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:05 2022] GET /identity/v3/users/66691c32d587443cb7787f9e28a6a013 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:05.353487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb16af-8588-404d-8c92-1728041317b0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:05.440834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:05.451470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 93/183] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:05.452645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678ca1b-ae12-471a-ac96-98a2af3e9440 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:05.471739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:05.487714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb16af-8588-404d-8c92-1728041317b0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:05.526051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f031c9-b017-4e13-9e96-9714a3388b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:05.526698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f031c9-b017-4e13-9e96-9714a3388b35 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.526975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f031c9-b017-4e13-9e96-9714a3388b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.527266 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f031c9-b017-4e13-9e96-9714a3388b35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.544073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f031c9-b017-4e13-9e96-9714a3388b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-a6f031c9-b017-4e13-9e96-9714a3388b35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:05.555034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:05.556027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:05.556820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:05.557420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 91/184] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:09:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:05.563612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03faf5-7b5c-4306-a0f2-9cf3895dddae None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.563612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03faf5-7b5c-4306-a0f2-9cf3895dddae None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.563930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03faf5-7b5c-4306-a0f2-9cf3895dddae None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.565570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 92/185] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:05.571122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a5dae-93ac-4622-9400-f7f16ac4bd0d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.571431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a5dae-93ac-4622-9400-f7f16ac4bd0d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.571706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a5dae-93ac-4622-9400-f7f16ac4bd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.595422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-dc0a5dae-93ac-4622-9400-f7f16ac4bd0d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:05.597005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-dc0a5dae-93ac-4622-9400-f7f16ac4bd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:05.600842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678ca1b-ae12-471a-ac96-98a2af3e9440 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:05.653760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a699c4-e1cc-4dce-87f4-e42622020e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:05.654385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a699c4-e1cc-4dce-87f4-e42622020e8a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.654660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a699c4-e1cc-4dce-87f4-e42622020e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.654930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a699c4-e1cc-4dce-87f4-e42622020e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.690118 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 93/186] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:05.690971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a5dae-93ac-4622-9400-f7f16ac4bd0d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:05.733293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:05.737282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a699c4-e1cc-4dce-87f4-e42622020e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:05.738939 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a699c4-e1cc-4dce-87f4-e42622020e8a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:05.763732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:05.788747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a5dae-93ac-4622-9400-f7f16ac4bd0d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:05.822803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8bee7-3fc1-4475-821c-fb90964c37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:05.823701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8bee7-3fc1-4475-821c-fb90964c37ac None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.824199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8bee7-3fc1-4475-821c-fb90964c37ac None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.824711 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8bee7-3fc1-4475-821c-fb90964c37ac None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.825541 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8bee7-3fc1-4475-821c-fb90964c37ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:05.826010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8bee7-3fc1-4475-821c-fb90964c37ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:05.827588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8bee7-3fc1-4475-821c-fb90964c37ac None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:05.835965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 94/187] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:05.841318 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8bee7-3fc1-4475-821c-fb90964c37ac None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:05.846862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 94/188] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:05.846862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a699c4-e1cc-4dce-87f4-e42622020e8a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:05.945297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:05.949714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a699c4-e1cc-4dce-87f4-e42622020e8a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:05.952301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8bee7-3fc1-4475-821c-fb90964c37ac None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:05.983742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e194369-de15-48ed-acf6-824e78cfedc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:05.984374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e194369-de15-48ed-acf6-824e78cfedc2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.984649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e194369-de15-48ed-acf6-824e78cfedc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.984922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e194369-de15-48ed-acf6-824e78cfedc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.986006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e194369-de15-48ed-acf6-824e78cfedc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:05.986303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a68fd-2469-493f-858b-d8a6653c9875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:05.988024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a68fd-2469-493f-858b-d8a6653c9875 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:05.988129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e194369-de15-48ed-acf6-824e78cfedc2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:05.988300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a68fd-2469-493f-858b-d8a6653c9875 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:05.988563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a68fd-2469-493f-858b-d8a6653c9875 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:05.989670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 95/189] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:05.991173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:05.992026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e194369-de15-48ed-acf6-824e78cfedc2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.000196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a68fd-2469-493f-858b-d8a6653c9875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-624a68fd-2469-493f-858b-d8a6653c9875 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:06.005227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:06.006189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:06.006961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 95/190] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:06.008136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a68fd-2469-493f-858b-d8a6653c9875 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.088486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e194369-de15-48ed-acf6-824e78cfedc2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:06.105527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a68fd-2469-493f-858b-d8a6653c9875 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:06.121318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f380a-725f-4d2a-a4f2-c86ab70a643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:06.122006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f380a-725f-4d2a-a4f2-c86ab70a643e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:06.122371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f380a-725f-4d2a-a4f2-c86ab70a643e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:06.122715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f380a-725f-4d2a-a4f2-c86ab70a643e None admin] PATH_INFO: `/v3/users/611b4a459a1f4889956fb469e4bfd9fe` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:06.135371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f380a-725f-4d2a-a4f2-c86ab70a643e None admin] RBAC: Authorizing `identity:get_user(user_id=611b4a459a1f4889956fb469e4bfd9fe)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:06.136814 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f380a-725f-4d2a-a4f2-c86ab70a643e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:06.138185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368b966-7e54-4bb5-8235-491d236399d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:06.138374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 96/191] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:05 2022] GET /identity/v3/users/611b4a459a1f4889956fb469e4bfd9fe => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:06.143174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368b966-7e54-4bb5-8235-491d236399d9 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:06.143307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f380a-725f-4d2a-a4f2-c86ab70a643e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.143400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368b966-7e54-4bb5-8235-491d236399d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:06.143400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368b966-7e54-4bb5-8235-491d236399d9 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:06.143400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368b966-7e54-4bb5-8235-491d236399d9 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:06.143400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368b966-7e54-4bb5-8235-491d236399d9 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:06.144592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 96/192] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:06 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:06.145397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368b966-7e54-4bb5-8235-491d236399d9 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.165612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:06.208354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:06.242393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f380a-725f-4d2a-a4f2-c86ab70a643e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:06.247604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368b966-7e54-4bb5-8235-491d236399d9 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:06.276270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5c12a-617a-4721-b512-3dfad252affb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:06.276916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5c12a-617a-4721-b512-3dfad252affb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:06.277191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5c12a-617a-4721-b512-3dfad252affb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:06.277458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5c12a-617a-4721-b512-3dfad252affb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:06.279596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152e8be-3fe0-4630-b898-65fbee739648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:06.280203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152e8be-3fe0-4630-b898-65fbee739648 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:06.280475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152e8be-3fe0-4630-b898-65fbee739648 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:06.280742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152e8be-3fe0-4630-b898-65fbee739648 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:06.281377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152e8be-3fe0-4630-b898-65fbee739648 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:06.282839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152e8be-3fe0-4630-b898-65fbee739648 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:06.287946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5c12a-617a-4721-b512-3dfad252affb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9ac5c12a-617a-4721-b512-3dfad252affb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:06.292933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:06.293974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 97/193] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:06.295577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5c12a-617a-4721-b512-3dfad252affb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.308606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 97/194] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:09:06 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:09:06.309489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152e8be-3fe0-4630-b898-65fbee739648 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.389379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:06.408773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5c12a-617a-4721-b512-3dfad252affb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:06.439935 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152e8be-3fe0-4630-b898-65fbee739648 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:06.450874 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78f661-8dba-48ea-b0f4-2a2f047e8d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:06.452079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78f661-8dba-48ea-b0f4-2a2f047e8d4c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:06.452560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78f661-8dba-48ea-b0f4-2a2f047e8d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:06.452991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78f661-8dba-48ea-b0f4-2a2f047e8d4c None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:06.453696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78f661-8dba-48ea-b0f4-2a2f047e8d4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:06.454024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78f661-8dba-48ea-b0f4-2a2f047e8d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:06.455523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78f661-8dba-48ea-b0f4-2a2f047e8d4c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:06.464178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:06.464346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 98/195] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:06.465235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78f661-8dba-48ea-b0f4-2a2f047e8d4c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.484627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed7ed9-39bf-4706-bd8c-8af01e91af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:06.485629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed7ed9-39bf-4706-bd8c-8af01e91af7b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:06.485629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed7ed9-39bf-4706-bd8c-8af01e91af7b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:06.485790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed7ed9-39bf-4706-bd8c-8af01e91af7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:06.571286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed7ed9-39bf-4706-bd8c-8af01e91af7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:06.572436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed7ed9-39bf-4706-bd8c-8af01e91af7b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:06.590070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78f661-8dba-48ea-b0f4-2a2f047e8d4c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:06.629934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75041190-c9f0-469c-a120-0be4be827e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:06.630546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75041190-c9f0-469c-a120-0be4be827e87 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:06.630820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75041190-c9f0-469c-a120-0be4be827e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:06.631088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75041190-c9f0-469c-a120-0be4be827e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:06.631859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75041190-c9f0-469c-a120-0be4be827e87 None admin] RBAC: Adding query filter params (role.id=b6a39390284c4cef8e11ad0888016b38, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64, user.id=66691c32d587443cb7787f9e28a6a013) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:06.632158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75041190-c9f0-469c-a120-0be4be827e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:06.633593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75041190-c9f0-469c-a120-0be4be827e87 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:06.642796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 99/196] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:06 2022] GET /identity/v3/role_assignments?user.id=66691c32d587443cb7787f9e28a6a013&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:06.643427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75041190-c9f0-469c-a120-0be4be827e87 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.657401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:06.700469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 98/197] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:06.701291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed7ed9-39bf-4706-bd8c-8af01e91af7b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.728611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:06.765527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75041190-c9f0-469c-a120-0be4be827e87 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:06.801780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d264952-0c56-40b7-a25f-f9c05da922d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:06.802698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d264952-0c56-40b7-a25f-f9c05da922d8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:06.803114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d264952-0c56-40b7-a25f-f9c05da922d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:06.803590 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d264952-0c56-40b7-a25f-f9c05da922d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:06.804413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d264952-0c56-40b7-a25f-f9c05da922d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:06.804875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d264952-0c56-40b7-a25f-f9c05da922d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:06.806408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d264952-0c56-40b7-a25f-f9c05da922d8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:06.816265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 100/198] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:06.818552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d264952-0c56-40b7-a25f-f9c05da922d8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.873640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed7ed9-39bf-4706-bd8c-8af01e91af7b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:06.906115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:06.915879 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c0478-9db5-4519-92a5-fe1fd286906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:06.916776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c0478-9db5-4519-92a5-fe1fd286906b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:06.917494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c0478-9db5-4519-92a5-fe1fd286906b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:06.917939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c0478-9db5-4519-92a5-fe1fd286906b None admin] PATH_INFO: `/v3/users/611b4a459a1f4889956fb469e4bfd9fe` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:06.919300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c0478-9db5-4519-92a5-fe1fd286906b None admin] RBAC: Authorizing `identity:get_user(user_id=611b4a459a1f4889956fb469e4bfd9fe)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:06.920964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c0478-9db5-4519-92a5-fe1fd286906b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:06.922756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 99/199] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:06 2022] GET /identity/v3/users/611b4a459a1f4889956fb469e4bfd9fe => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:06.923861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c0478-9db5-4519-92a5-fe1fd286906b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:06.938182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d264952-0c56-40b7-a25f-f9c05da922d8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:06.985644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae4e5-29b1-445c-8a2e-71e34e8f8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:06.986291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae4e5-29b1-445c-8a2e-71e34e8f8705 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:06.986685 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae4e5-29b1-445c-8a2e-71e34e8f8705 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:06.987011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae4e5-29b1-445c-8a2e-71e34e8f8705 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:06.988671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ae4e5-29b1-445c-8a2e-71e34e8f8705 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:06.990845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ae4e5-29b1-445c-8a2e-71e34e8f8705 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:06.998071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 101/200] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:06 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:06.998071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae4e5-29b1-445c-8a2e-71e34e8f8705 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:07.030999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:07.049336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c0478-9db5-4519-92a5-fe1fd286906b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:07.107190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a4213-0d42-4a9a-8699-89116c232cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:07.107909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4213-0d42-4a9a-8699-89116c232cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:07.108188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4213-0d42-4a9a-8699-89116c232cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:07.108453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4213-0d42-4a9a-8699-89116c232cd7 None admin] PATH_INFO: `/v3/users/c9217d49f4d544b29aa65b7138832607` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:07.109897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a4213-0d42-4a9a-8699-89116c232cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=c9217d49f4d544b29aa65b7138832607)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:07.111784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a4213-0d42-4a9a-8699-89116c232cd7 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:07.114106 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 100/201] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:06 2022] GET /identity/v3/users/c9217d49f4d544b29aa65b7138832607 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:07.114878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a4213-0d42-4a9a-8699-89116c232cd7 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:07.141711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae4e5-29b1-445c-8a2e-71e34e8f8705 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:07.180854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e1253-8f9f-41b8-8f70-0771a870385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:07.181502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e1253-8f9f-41b8-8f70-0771a870385a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:07.181865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e1253-8f9f-41b8-8f70-0771a870385a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:07.182142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e1253-8f9f-41b8-8f70-0771a870385a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:07.197196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:07.235169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a4213-0d42-4a9a-8699-89116c232cd7 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:07.259594 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e1253-8f9f-41b8-8f70-0771a870385a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:07.261134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e1253-8f9f-41b8-8f70-0771a870385a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:07.270359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c433de-3d2d-4e0f-97d5-0084da324c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:07.270968 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c433de-3d2d-4e0f-97d5-0084da324c39 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:07.271244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c433de-3d2d-4e0f-97d5-0084da324c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:07.271644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c433de-3d2d-4e0f-97d5-0084da324c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:07.272371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c433de-3d2d-4e0f-97d5-0084da324c39 None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=77d2af586e494e72ba2b582af008f3a3, user.id=611b4a459a1f4889956fb469e4bfd9fe) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:07.272670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c433de-3d2d-4e0f-97d5-0084da324c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:07.274209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c433de-3d2d-4e0f-97d5-0084da324c39 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:07.280218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 101/202] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:07 2022] GET /identity/v3/role_assignments?user.id=611b4a459a1f4889956fb469e4bfd9fe&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:07.280767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c433de-3d2d-4e0f-97d5-0084da324c39 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:07.304674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:07.371859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 102/203] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:07.380484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e1253-8f9f-41b8-8f70-0771a870385a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:07.422683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c433de-3d2d-4e0f-97d5-0084da324c39 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:07.463365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18014eeb-de59-4024-82ff-596856fc6a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:07.463365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18014eeb-de59-4024-82ff-596856fc6a3e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:07.463365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18014eeb-de59-4024-82ff-596856fc6a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:07.463365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18014eeb-de59-4024-82ff-596856fc6a3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:07.466319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:07.534715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18014eeb-de59-4024-82ff-596856fc6a3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:07.537546 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18014eeb-de59-4024-82ff-596856fc6a3e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:07.559352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e1253-8f9f-41b8-8f70-0771a870385a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:07.562889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:07.600053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae2a4-62d0-4f56-8f2e-3c295baa5600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:07.601166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae2a4-62d0-4f56-8f2e-3c295baa5600 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:07.601692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae2a4-62d0-4f56-8f2e-3c295baa5600 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:07.602151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae2a4-62d0-4f56-8f2e-3c295baa5600 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:07.608002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bae2a4-62d0-4f56-8f2e-3c295baa5600 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:07.609695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bae2a4-62d0-4f56-8f2e-3c295baa5600 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:07.612019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 103/204] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:07 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:07.620478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae2a4-62d0-4f56-8f2e-3c295baa5600 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:07.652849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 102/205] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:07.658561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18014eeb-de59-4024-82ff-596856fc6a3e None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:07.771336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18014eeb-de59-4024-82ff-596856fc6a3e None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:07.791745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:07.807512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fea705-93d9-4f1c-a893-30a4f9b32157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:07.808179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fea705-93d9-4f1c-a893-30a4f9b32157 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:07.808458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fea705-93d9-4f1c-a893-30a4f9b32157 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:07.808727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fea705-93d9-4f1c-a893-30a4f9b32157 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:07.810058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fea705-93d9-4f1c-a893-30a4f9b32157 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:07.811655 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fea705-93d9-4f1c-a893-30a4f9b32157 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:07.813548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 103/206] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:07 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:07.820917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fea705-93d9-4f1c-a893-30a4f9b32157 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:07.822603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae2a4-62d0-4f56-8f2e-3c295baa5600 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:07.846977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:07.900836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c590324-5478-4ed4-ac15-6d698b67e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:07.901872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c590324-5478-4ed4-ac15-6d698b67e85e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:07.902337 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c590324-5478-4ed4-ac15-6d698b67e85e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:07.902786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c590324-5478-4ed4-ac15-6d698b67e85e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:07.903746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c590324-5478-4ed4-ac15-6d698b67e85e None admin] RBAC: Adding query filter params (role.id=4111136d5e114c4b9ca719aa39f4bc23, scope.project.id=77d2af586e494e72ba2b582af008f3a3, user.id=611b4a459a1f4889956fb469e4bfd9fe) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:07.904241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c590324-5478-4ed4-ac15-6d698b67e85e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:07.905865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c590324-5478-4ed4-ac15-6d698b67e85e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:07.925119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 104/207] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:07 2022] GET /identity/v3/role_assignments?user.id=611b4a459a1f4889956fb469e4bfd9fe&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=4111136d5e114c4b9ca719aa39f4bc23 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:07.959608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fea705-93d9-4f1c-a893-30a4f9b32157 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:07.997197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bce31-e902-4a5e-b39b-3a8684511a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:07.997869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bce31-e902-4a5e-b39b-3a8684511a94 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:07.998149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bce31-e902-4a5e-b39b-3a8684511a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:07.998421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bce31-e902-4a5e-b39b-3a8684511a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:07.999158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bce31-e902-4a5e-b39b-3a8684511a94 None admin] RBAC: Adding query filter params (role.id=aad7b5d260224bf496f850a91a555d72, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64, user.id=c9217d49f4d544b29aa65b7138832607) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:07.999553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bce31-e902-4a5e-b39b-3a8684511a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:08.001035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bce31-e902-4a5e-b39b-3a8684511a94 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:08.008172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 104/208] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:07 2022] GET /identity/v3/role_assignments?user.id=c9217d49f4d544b29aa65b7138832607&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=aad7b5d260224bf496f850a91a555d72 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:08.553919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f40e-1bc4-4034-b3e8-ff13f4dbb0dd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:08.554767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f40e-1bc4-4034-b3e8-ff13f4dbb0dd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:08.555176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f40e-1bc4-4034-b3e8-ff13f4dbb0dd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:08.556963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 105/209] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:08.562624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439da20-affb-4aed-bbbb-3e3c474d16c6 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:08.563477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439da20-affb-4aed-bbbb-3e3c474d16c6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:08.563941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439da20-affb-4aed-bbbb-3e3c474d16c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:08.582931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0439da20-affb-4aed-bbbb-3e3c474d16c6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:08.584512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0439da20-affb-4aed-bbbb-3e3c474d16c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:08.645734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:08.675354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 105/210] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:08.793080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930cd6b-b796-4751-9bb3-2668b31d3988 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:08.793404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930cd6b-b796-4751-9bb3-2668b31d3988 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:08.793628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930cd6b-b796-4751-9bb3-2668b31d3988 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:08.795114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 106/211] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:08.800501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fcadc-c500-43bd-9213-0d109af03424 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:08.801007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fcadc-c500-43bd-9213-0d109af03424 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:08.801530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fcadc-c500-43bd-9213-0d109af03424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:08.820228 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-171fcadc-c500-43bd-9213-0d109af03424 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:08.821680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-171fcadc-c500-43bd-9213-0d109af03424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:08.887619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 106/212] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:08.951114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930cd6b-b796-4751-9bb3-2668b31d3988 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:09.052545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930cd6b-b796-4751-9bb3-2668b31d3988 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:09.087919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bc2fc-e2c6-4bd4-99ad-326a52221b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:09.088571 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bc2fc-e2c6-4bd4-99ad-326a52221b17 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:09.088845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bc2fc-e2c6-4bd4-99ad-326a52221b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:09.089112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bc2fc-e2c6-4bd4-99ad-326a52221b17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:09.100967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bc2fc-e2c6-4bd4-99ad-326a52221b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3b8bc2fc-e2c6-4bd4-99ad-326a52221b17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:09.106666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:09.107570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:09.108352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 107/213] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:09.113845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fcadc-c500-43bd-9213-0d109af03424 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:09.182829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bc2fc-e2c6-4bd4-99ad-326a52221b17 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:09.228001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fcadc-c500-43bd-9213-0d109af03424 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:09.229958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:09.243804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:09.267532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb695b1-2728-4c7d-9b06-b935b3c88519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:09.268866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb695b1-2728-4c7d-9b06-b935b3c88519 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:09.269367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb695b1-2728-4c7d-9b06-b935b3c88519 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:09.269843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb695b1-2728-4c7d-9b06-b935b3c88519 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:09.270766 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb695b1-2728-4c7d-9b06-b935b3c88519 None admin] RBAC: Adding query filter params (name=member) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:09.271285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb695b1-2728-4c7d-9b06-b935b3c88519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:09.272899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb695b1-2728-4c7d-9b06-b935b3c88519 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:09.282498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 107/214] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:09.287724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb695b1-2728-4c7d-9b06-b935b3c88519 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:09.317104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bc2fc-e2c6-4bd4-99ad-326a52221b17 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:09.359379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aebb8c-ddbd-4b62-8035-e4102bb48faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:09.360031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aebb8c-ddbd-4b62-8035-e4102bb48faa None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:09.360479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aebb8c-ddbd-4b62-8035-e4102bb48faa None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:09.361011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aebb8c-ddbd-4b62-8035-e4102bb48faa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:09.362408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aebb8c-ddbd-4b62-8035-e4102bb48faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:09.364634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aebb8c-ddbd-4b62-8035-e4102bb48faa None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:09.371557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 108/215] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:09.373221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aebb8c-ddbd-4b62-8035-e4102bb48faa None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:09.392817 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb695b1-2728-4c7d-9b06-b935b3c88519 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:09.427406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c166dc-e21b-4a7a-a425-e64a25ce3934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:09.428365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c166dc-e21b-4a7a-a425-e64a25ce3934 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:09.428774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c166dc-e21b-4a7a-a425-e64a25ce3934 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:09.429177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c166dc-e21b-4a7a-a425-e64a25ce3934 None admin] PATH_INFO: `/v3/users/2c0db5c1682b4326b65972f4d68903c2` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:09.444382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c166dc-e21b-4a7a-a425-e64a25ce3934 None admin] RBAC: Authorizing `identity:get_user(user_id=2c0db5c1682b4326b65972f4d68903c2)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:09.446179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c166dc-e21b-4a7a-a425-e64a25ce3934 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:09.448230 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 108/216] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:09 2022] GET /identity/v3/users/2c0db5c1682b4326b65972f4d68903c2 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:09.454077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c166dc-e21b-4a7a-a425-e64a25ce3934 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:09.491756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:09.495560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aebb8c-ddbd-4b62-8035-e4102bb48faa None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:09.511632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:09.537368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15a5fe-9beb-447c-a562-23dcdfe45a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:09.538015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a5fe-9beb-447c-a562-23dcdfe45a54 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:09.538350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a5fe-9beb-447c-a562-23dcdfe45a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:09.538809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a5fe-9beb-447c-a562-23dcdfe45a54 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:09.539663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15a5fe-9beb-447c-a562-23dcdfe45a54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:09.541371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15a5fe-9beb-447c-a562-23dcdfe45a54 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:09.567014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 109/217] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:09:09 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:09:09.568611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7481867-061e-4209-95b9-4a1d33cb326d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:09.568916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7481867-061e-4209-95b9-4a1d33cb326d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:09.569195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7481867-061e-4209-95b9-4a1d33cb326d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:09.570746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 110/218] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:09.574758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c166dc-e21b-4a7a-a425-e64a25ce3934 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:09.582129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64317fe4-8a55-4479-85a7-b8649657a831 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:09.582419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64317fe4-8a55-4479-85a7-b8649657a831 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:09.582649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64317fe4-8a55-4479-85a7-b8649657a831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:09.605956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-64317fe4-8a55-4479-85a7-b8649657a831 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:09.608486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-64317fe4-8a55-4479-85a7-b8649657a831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:09.618384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f4387-cebf-4712-aad8-cf4edccf75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:09.619051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f4387-cebf-4712-aad8-cf4edccf75d8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:09.619367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f4387-cebf-4712-aad8-cf4edccf75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:09.619637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f4387-cebf-4712-aad8-cf4edccf75d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:09.700714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f4387-cebf-4712-aad8-cf4edccf75d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:09.701337 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 111/219] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:09.702728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f4387-cebf-4712-aad8-cf4edccf75d8 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:09.741359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:09.815845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 109/220] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:09.821540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64317fe4-8a55-4479-85a7-b8649657a831 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:09.914770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:09.932622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64317fe4-8a55-4479-85a7-b8649657a831 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:09.968548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61226e7d-fede-4508-8801-48fb5ef8690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:09.969252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61226e7d-fede-4508-8801-48fb5ef8690b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:09.969470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61226e7d-fede-4508-8801-48fb5ef8690b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:09.969742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61226e7d-fede-4508-8801-48fb5ef8690b None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:09.971035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61226e7d-fede-4508-8801-48fb5ef8690b None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:09.972605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61226e7d-fede-4508-8801-48fb5ef8690b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:09.974574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 112/221] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:09 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:09.980215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f4387-cebf-4712-aad8-cf4edccf75d8 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:09.980386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61226e7d-fede-4508-8801-48fb5ef8690b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:10.100967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61226e7d-fede-4508-8801-48fb5ef8690b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:10.109450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f4387-cebf-4712-aad8-cf4edccf75d8 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:10.141431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:10.144767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8a146-d9dc-4de4-b5f3-854237846c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:10.145423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8a146-d9dc-4de4-b5f3-854237846c1f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:10.145910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8a146-d9dc-4de4-b5f3-854237846c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:10.146390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8a146-d9dc-4de4-b5f3-854237846c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:10.146762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2e0c6-466c-4ba9-9fa5-d962851d211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:10.147291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8a146-d9dc-4de4-b5f3-854237846c1f None admin] RBAC: Adding query filter params (role.id=b6a39390284c4cef8e11ad0888016b38, scope.project.id=77d2af586e494e72ba2b582af008f3a3, user.id=2c0db5c1682b4326b65972f4d68903c2) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:10.147602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8a146-d9dc-4de4-b5f3-854237846c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:10.147920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2e0c6-466c-4ba9-9fa5-d962851d211b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:10.148347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2e0c6-466c-4ba9-9fa5-d962851d211b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:10.148752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2e0c6-466c-4ba9-9fa5-d962851d211b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:10.149030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8a146-d9dc-4de4-b5f3-854237846c1f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:10.155626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 113/222] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:09 2022] GET /identity/v3/role_assignments?user.id=2c0db5c1682b4326b65972f4d68903c2&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:10.157196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328fde7-18cd-420c-8213-b7d0d5253964 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:10.158001 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328fde7-18cd-420c-8213-b7d0d5253964 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:10.158505 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328fde7-18cd-420c-8213-b7d0d5253964 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:10.160142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 114/223] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:10.165252 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2e0c6-466c-4ba9-9fa5-d962851d211b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:10.166520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c481-9cef-40b9-9a5a-428c5bf9fe16 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:10.166934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c481-9cef-40b9-9a5a-428c5bf9fe16 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:10.167386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c481-9cef-40b9-9a5a-428c5bf9fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-84a2e0c6-466c-4ba9-9fa5-d962851d211b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:10.170549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:10.171677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:10.172692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:10.175462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 110/224] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:09:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:10.184213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2e0c6-466c-4ba9-9fa5-d962851d211b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:10.192679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b166c481-9cef-40b9-9a5a-428c5bf9fe16 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:10.192679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b166c481-9cef-40b9-9a5a-428c5bf9fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:10.210608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:10.279690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 115/225] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:10.317294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2e0c6-466c-4ba9-9fa5-d962851d211b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:10.362996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bbe2e-68eb-4da4-9c29-d68b0222840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:10.363943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bbe2e-68eb-4da4-9c29-d68b0222840b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:10.364391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bbe2e-68eb-4da4-9c29-d68b0222840b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:10.364827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bbe2e-68eb-4da4-9c29-d68b0222840b None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:10.365667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bbe2e-68eb-4da4-9c29-d68b0222840b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:10.366195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bbe2e-68eb-4da4-9c29-d68b0222840b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:10.367862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bbe2e-68eb-4da4-9c29-d68b0222840b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:10.381047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 111/226] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:10.386971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166c481-9cef-40b9-9a5a-428c5bf9fe16 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:10.509957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166c481-9cef-40b9-9a5a-428c5bf9fe16 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:10.545509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c83caf-5b00-4277-9f6b-0499d3db663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:10.546497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c83caf-5b00-4277-9f6b-0499d3db663d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:10.546943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c83caf-5b00-4277-9f6b-0499d3db663d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:10.547410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c83caf-5b00-4277-9f6b-0499d3db663d None admin] PATH_INFO: `/v3/users/611b4a459a1f4889956fb469e4bfd9fe` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:10.548793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c83caf-5b00-4277-9f6b-0499d3db663d None admin] RBAC: Authorizing `identity:get_user(user_id=611b4a459a1f4889956fb469e4bfd9fe)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:10.550566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c83caf-5b00-4277-9f6b-0499d3db663d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:10.552464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 116/227] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:10 2022] GET /identity/v3/users/611b4a459a1f4889956fb469e4bfd9fe => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:10.558444 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bbe2e-68eb-4da4-9c29-d68b0222840b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:10.616451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c83caf-5b00-4277-9f6b-0499d3db663d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:10.633212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:10.639237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:10.727125 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c83caf-5b00-4277-9f6b-0499d3db663d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:10.764277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1801413-f3f2-4889-a942-16841726f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:10.765191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1801413-f3f2-4889-a942-16841726f0ab None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:10.765636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1801413-f3f2-4889-a942-16841726f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:10.766087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1801413-f3f2-4889-a942-16841726f0ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:10.776951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1801413-f3f2-4889-a942-16841726f0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:10.777226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bbe2e-68eb-4da4-9c29-d68b0222840b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d1801413-f3f2-4889-a942-16841726f0ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:10.782561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:10.783462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:10.784219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:10.787077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 117/228] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:10.793558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1801413-f3f2-4889-a942-16841726f0ab None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:10.875653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:10.889660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061c1a0-3299-4f73-ba7a-e52e6a69e506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:10.890286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061c1a0-3299-4f73-ba7a-e52e6a69e506 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:10.890565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061c1a0-3299-4f73-ba7a-e52e6a69e506 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:10.890835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061c1a0-3299-4f73-ba7a-e52e6a69e506 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:10.896546 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061c1a0-3299-4f73-ba7a-e52e6a69e506 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:10.898120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061c1a0-3299-4f73-ba7a-e52e6a69e506 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:10.899899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 112/229] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:10 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:10.902163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1801413-f3f2-4889-a942-16841726f0ab None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:10.905530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061c1a0-3299-4f73-ba7a-e52e6a69e506 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:10.940545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a8ecc-f3d9-4625-9eee-01fe263dbf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:10.941970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a8ecc-f3d9-4625-9eee-01fe263dbf89 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:10.942440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a8ecc-f3d9-4625-9eee-01fe263dbf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:10.942923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a8ecc-f3d9-4625-9eee-01fe263dbf89 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:10.944048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a8ecc-f3d9-4625-9eee-01fe263dbf89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:10.944591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a8ecc-f3d9-4625-9eee-01fe263dbf89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:10.946333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a8ecc-f3d9-4625-9eee-01fe263dbf89 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:10.959731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 118/230] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:10.962140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a8ecc-f3d9-4625-9eee-01fe263dbf89 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:11.071989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a8ecc-f3d9-4625-9eee-01fe263dbf89 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:11.108355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be7f50-1a5a-47ea-996b-61193b9e1a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:11.109402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be7f50-1a5a-47ea-996b-61193b9e1a5f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:11.109963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be7f50-1a5a-47ea-996b-61193b9e1a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:11.110557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be7f50-1a5a-47ea-996b-61193b9e1a5f None admin] PATH_INFO: `/v3/users/611b4a459a1f4889956fb469e4bfd9fe` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:11.116081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be7f50-1a5a-47ea-996b-61193b9e1a5f None admin] RBAC: Authorizing `identity:get_user(user_id=611b4a459a1f4889956fb469e4bfd9fe)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:11.117838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be7f50-1a5a-47ea-996b-61193b9e1a5f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:11.124587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 119/231] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:10 2022] GET /identity/v3/users/611b4a459a1f4889956fb469e4bfd9fe => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:11.129619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be7f50-1a5a-47ea-996b-61193b9e1a5f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:11.143626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:11.150921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061c1a0-3299-4f73-ba7a-e52e6a69e506 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:11.175110 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:11.227981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ad2fe-1f41-4dda-b2cb-11c17c4ac3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:11.228671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad2fe-1f41-4dda-b2cb-11c17c4ac3b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:11.228956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad2fe-1f41-4dda-b2cb-11c17c4ac3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:11.229322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad2fe-1f41-4dda-b2cb-11c17c4ac3b3 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3/users/611b4a459a1f4889956fb469e4bfd9fe/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:11.235979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ad2fe-1f41-4dda-b2cb-11c17c4ac3b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=77d2af586e494e72ba2b582af008f3a3, user_id=611b4a459a1f4889956fb469e4bfd9fe, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:11.237789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ad2fe-1f41-4dda-b2cb-11c17c4ac3b3 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:11.243803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be7f50-1a5a-47ea-996b-61193b9e1a5f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:11.258771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 113/232] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:09:10 2022] PUT /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3/users/611b4a459a1f4889956fb469e4bfd9fe/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:11.288488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb7c46-98dc-48d2-9d2f-7ed8f12f488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:11.289206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb7c46-98dc-48d2-9d2f-7ed8f12f488b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:11.289488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb7c46-98dc-48d2-9d2f-7ed8f12f488b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:11.289755 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb7c46-98dc-48d2-9d2f-7ed8f12f488b None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:11.291039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb7c46-98dc-48d2-9d2f-7ed8f12f488b None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:11.292581 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb7c46-98dc-48d2-9d2f-7ed8f12f488b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:11.294666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 120/233] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:11 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:11.300569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ad2fe-1f41-4dda-b2cb-11c17c4ac3b3 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:11.421519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ad2fe-1f41-4dda-b2cb-11c17c4ac3b3 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:11.458531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17317c07-87a5-4061-b08a-92e393bee20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:11.459213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17317c07-87a5-4061-b08a-92e393bee20c None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:11.459527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17317c07-87a5-4061-b08a-92e393bee20c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:11.459799 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17317c07-87a5-4061-b08a-92e393bee20c None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3/users/611b4a459a1f4889956fb469e4bfd9fe/roles/4111136d5e114c4b9ca719aa39f4bc23` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:11.462274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17317c07-87a5-4061-b08a-92e393bee20c None admin] RBAC: Authorizing `identity:create_grant(project_id=77d2af586e494e72ba2b582af008f3a3, user_id=611b4a459a1f4889956fb469e4bfd9fe, role_id=4111136d5e114c4b9ca719aa39f4bc23)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:11.463783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17317c07-87a5-4061-b08a-92e393bee20c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:11.489227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 114/234] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:09:11 2022] PUT /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3/users/611b4a459a1f4889956fb469e4bfd9fe/roles/4111136d5e114c4b9ca719aa39f4bc23 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:11.994213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95792bf-9b5e-4464-8744-3423dc53c94e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:11.994733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95792bf-9b5e-4464-8744-3423dc53c94e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:11.994733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95792bf-9b5e-4464-8744-3423dc53c94e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:11.996373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 121/235] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:12.001511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794cf0-b758-43d4-9702-cfdde578bb02 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:12.001905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794cf0-b758-43d4-9702-cfdde578bb02 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:12.002397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794cf0-b758-43d4-9702-cfdde578bb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:12.021220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-51794cf0-b758-43d4-9702-cfdde578bb02 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:12.022408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-51794cf0-b758-43d4-9702-cfdde578bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:12.059967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:12.097502 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 115/236] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:12.117838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5c28b-bbb9-4453-8492-f16494dc4e41 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:12.118134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5c28b-bbb9-4453-8492-f16494dc4e41 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:12.118381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5c28b-bbb9-4453-8492-f16494dc4e41 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:12.120027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 122/237] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:12.125214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf34049-de9d-41b3-9e21-ebc83a506a1e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:12.125494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf34049-de9d-41b3-9e21-ebc83a506a1e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:12.125762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf34049-de9d-41b3-9e21-ebc83a506a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:12.144516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-aaf34049-de9d-41b3-9e21-ebc83a506a1e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:12.145696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-aaf34049-de9d-41b3-9e21-ebc83a506a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:12.226481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 116/238] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:12.452783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5c28b-bbb9-4453-8492-f16494dc4e41 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:12.537565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:12.543355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf34049-de9d-41b3-9e21-ebc83a506a1e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:12.570207 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5c28b-bbb9-4453-8492-f16494dc4e41 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:12.609937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba201bcd-f0d2-4a09-9cf9-2d5b0c15e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:12.610867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba201bcd-f0d2-4a09-9cf9-2d5b0c15e02a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:12.611409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba201bcd-f0d2-4a09-9cf9-2d5b0c15e02a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:12.611861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba201bcd-f0d2-4a09-9cf9-2d5b0c15e02a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:12.625172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba201bcd-f0d2-4a09-9cf9-2d5b0c15e02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ba201bcd-f0d2-4a09-9cf9-2d5b0c15e02a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:12.631057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:12.631969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:12.632732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:12.636061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 123/239] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:12.641591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba201bcd-f0d2-4a09-9cf9-2d5b0c15e02a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:12.704809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf34049-de9d-41b3-9e21-ebc83a506a1e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:12.706699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:12.743807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bed67-f4aa-479e-8912-4fcb1f502fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:12.744675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bed67-f4aa-479e-8912-4fcb1f502fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:12.745114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bed67-f4aa-479e-8912-4fcb1f502fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:12.745520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bed67-f4aa-479e-8912-4fcb1f502fb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:12.746876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bed67-f4aa-479e-8912-4fcb1f502fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:12.748542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bed67-f4aa-479e-8912-4fcb1f502fb6 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:12.750752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 117/240] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:12.752409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8d8d6-61d0-4eef-bfe2-73c335cef24b None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:12.752888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8d8d6-61d0-4eef-bfe2-73c335cef24b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:12.753458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8d8d6-61d0-4eef-bfe2-73c335cef24b None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:12.754848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 118/241] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:12.759029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba201bcd-f0d2-4a09-9cf9-2d5b0c15e02a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:12.760644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f0b02-0f5d-4c36-987e-ed43d9244739 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:12.761099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f0b02-0f5d-4c36-987e-ed43d9244739 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:12.761495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f0b02-0f5d-4c36-987e-ed43d9244739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:12.780733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f91f0b02-0f5d-4c36-987e-ed43d9244739 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:12.782148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f91f0b02-0f5d-4c36-987e-ed43d9244739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:12.796467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae51b6-fe64-4ec3-baee-d719592c42ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:12.797623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae51b6-fe64-4ec3-baee-d719592c42ab None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:12.798552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae51b6-fe64-4ec3-baee-d719592c42ab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:12.799130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae51b6-fe64-4ec3-baee-d719592c42ab None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:12.800541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae51b6-fe64-4ec3-baee-d719592c42ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:12.801238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae51b6-fe64-4ec3-baee-d719592c42ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:12.803183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae51b6-fe64-4ec3-baee-d719592c42ab None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:12.805354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:12.821980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 124/242] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:12.823153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae51b6-fe64-4ec3-baee-d719592c42ab None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:12.875282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 119/243] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:12.875282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f0b02-0f5d-4c36-987e-ed43d9244739 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:13.002446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae51b6-fe64-4ec3-baee-d719592c42ab None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:13.018503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f0b02-0f5d-4c36-987e-ed43d9244739 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:13.022156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:13.068016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc912958-c752-4cd5-9ff4-981a3e5e4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:13.068651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912958-c752-4cd5-9ff4-981a3e5e4107 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.068927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912958-c752-4cd5-9ff4-981a3e5e4107 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.069197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912958-c752-4cd5-9ff4-981a3e5e4107 None admin] PATH_INFO: `/v3/users/af69768eb7284470beb96357a71a0b3d` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.070334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdb8fa-7dd2-4a1f-8f04-8a7008734cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:13.070941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdb8fa-7dd2-4a1f-8f04-8a7008734cf0 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.071208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdb8fa-7dd2-4a1f-8f04-8a7008734cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.071495 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdb8fa-7dd2-4a1f-8f04-8a7008734cf0 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.072203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdb8fa-7dd2-4a1f-8f04-8a7008734cf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:13.073647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdb8fa-7dd2-4a1f-8f04-8a7008734cf0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:13.094803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc912958-c752-4cd5-9ff4-981a3e5e4107 None admin] RBAC: Authorizing `identity:get_user(user_id=af69768eb7284470beb96357a71a0b3d)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:13.096597 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc912958-c752-4cd5-9ff4-981a3e5e4107 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:13.098356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 120/244] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:12 2022] GET /identity/v3/users/af69768eb7284470beb96357a71a0b3d => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:13.108724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc912958-c752-4cd5-9ff4-981a3e5e4107 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:13.120588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 125/245] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:09:12 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:09:13.236817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdb8fa-7dd2-4a1f-8f04-8a7008734cf0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:13.254806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc912958-c752-4cd5-9ff4-981a3e5e4107 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:13.304689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563123-6a23-46c3-912d-834ae4440665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:13.305317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563123-6a23-46c3-912d-834ae4440665 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.305645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563123-6a23-46c3-912d-834ae4440665 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.305916 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563123-6a23-46c3-912d-834ae4440665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.309938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:13.351674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:13.396740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdb8fa-7dd2-4a1f-8f04-8a7008734cf0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:13.407698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca563123-6a23-46c3-912d-834ae4440665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:13.409257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca563123-6a23-46c3-912d-834ae4440665 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:13.432538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0dd53-17de-4d35-939a-e161512d05e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:13.433181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0dd53-17de-4d35-939a-e161512d05e0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.433455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0dd53-17de-4d35-939a-e161512d05e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.433721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0dd53-17de-4d35-939a-e161512d05e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.445438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0dd53-17de-4d35-939a-e161512d05e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-79f0dd53-17de-4d35-939a-e161512d05e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:13.450718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:13.451624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:13.452429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:13.453016 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 126/246] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:13.458751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0dd53-17de-4d35-939a-e161512d05e0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:13.518696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 121/247] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:13.524476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563123-6a23-46c3-912d-834ae4440665 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:13.568194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0dd53-17de-4d35-939a-e161512d05e0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:13.581348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:13.586825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:13.606444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92354-5b9c-4b70-a426-0b82762dedfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:13.607062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92354-5b9c-4b70-a426-0b82762dedfb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.607365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92354-5b9c-4b70-a426-0b82762dedfb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.607633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92354-5b9c-4b70-a426-0b82762dedfb None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.608300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92354-5b9c-4b70-a426-0b82762dedfb None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:13.608593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92354-5b9c-4b70-a426-0b82762dedfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:13.610028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92354-5b9c-4b70-a426-0b82762dedfb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:13.619122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 127/248] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:13.625036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92354-5b9c-4b70-a426-0b82762dedfb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:13.633073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563123-6a23-46c3-912d-834ae4440665 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:13.670136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31ca38-0324-45fc-be12-308e9983c10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:13.670869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31ca38-0324-45fc-be12-308e9983c10a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.671148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31ca38-0324-45fc-be12-308e9983c10a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.671447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31ca38-0324-45fc-be12-308e9983c10a None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.672563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31ca38-0324-45fc-be12-308e9983c10a None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:13.674552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31ca38-0324-45fc-be12-308e9983c10a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:13.676643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 122/249] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:13 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:13.682498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31ca38-0324-45fc-be12-308e9983c10a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:13.730014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92354-5b9c-4b70-a426-0b82762dedfb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:13.764986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5fbf7-fa66-4d80-9c2d-95744f2381cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:13.765667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5fbf7-fa66-4d80-9c2d-95744f2381cc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.765943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5fbf7-fa66-4d80-9c2d-95744f2381cc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.766213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5fbf7-fa66-4d80-9c2d-95744f2381cc None admin] PATH_INFO: `/v3/users/2c0db5c1682b4326b65972f4d68903c2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.767358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5fbf7-fa66-4d80-9c2d-95744f2381cc None admin] RBAC: Authorizing `identity:get_user(user_id=2c0db5c1682b4326b65972f4d68903c2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:13.769314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5fbf7-fa66-4d80-9c2d-95744f2381cc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:13.771146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 128/250] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:13 2022] GET /identity/v3/users/2c0db5c1682b4326b65972f4d68903c2 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:13.776631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5fbf7-fa66-4d80-9c2d-95744f2381cc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:13.792919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31ca38-0324-45fc-be12-308e9983c10a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:13.819297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:13.828617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:13.834810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e9f4f-5fc0-414e-b2b1-6d0aa05dfd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:13.835470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e9f4f-5fc0-414e-b2b1-6d0aa05dfd13 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.835749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e9f4f-5fc0-414e-b2b1-6d0aa05dfd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.836018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e9f4f-5fc0-414e-b2b1-6d0aa05dfd13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.836989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e9f4f-5fc0-414e-b2b1-6d0aa05dfd13 None admin] RBAC: Adding query filter params (role.id=aad7b5d260224bf496f850a91a555d72, scope.project.id=77d2af586e494e72ba2b582af008f3a3, user.id=af69768eb7284470beb96357a71a0b3d) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:13.837092 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e9f4f-5fc0-414e-b2b1-6d0aa05dfd13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:13.838498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e9f4f-5fc0-414e-b2b1-6d0aa05dfd13 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:13.844512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 123/251] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:13 2022] GET /identity/v3/role_assignments?user.id=af69768eb7284470beb96357a71a0b3d&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=aad7b5d260224bf496f850a91a555d72 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:13.845717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60846ad6-b878-44a0-a8e8-5e31750044d5 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.846036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60846ad6-b878-44a0-a8e8-5e31750044d5 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.846309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60846ad6-b878-44a0-a8e8-5e31750044d5 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.857594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 124/252] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:13.865513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453887a-4e27-41c7-b83f-1c0a6c1014f7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.866213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453887a-4e27-41c7-b83f-1c0a6c1014f7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.866726 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453887a-4e27-41c7-b83f-1c0a6c1014f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.896848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b453887a-4e27-41c7-b83f-1c0a6c1014f7 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:13.898170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b453887a-4e27-41c7-b83f-1c0a6c1014f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:13.901775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5fbf7-fa66-4d80-9c2d-95744f2381cc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:13.948928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc346d3c-8215-49f9-a6ef-65705de4f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:13.950517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346d3c-8215-49f9-a6ef-65705de4f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:13.950800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346d3c-8215-49f9-a6ef-65705de4f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:13.951076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346d3c-8215-49f9-a6ef-65705de4f9b0 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:13.955042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc346d3c-8215-49f9-a6ef-65705de4f9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:13.956886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc346d3c-8215-49f9-a6ef-65705de4f9b0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:13.959043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 129/253] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:13 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:13.969481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc346d3c-8215-49f9-a6ef-65705de4f9b0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:13.997297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 125/254] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:14.081745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc346d3c-8215-49f9-a6ef-65705de4f9b0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:14.086889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc329-63d9-457f-95ab-b6436540559a None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:14.087760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc329-63d9-457f-95ab-b6436540559a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:14.088040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc329-63d9-457f-95ab-b6436540559a None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:14.089552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 126/255] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:09:14.094030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:14.096008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b863-ee03-467f-a4cb-43914267a731 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:14.096319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b863-ee03-467f-a4cb-43914267a731 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:14.096571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b863-ee03-467f-a4cb-43914267a731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:14.116803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a2c5b863-ee03-467f-a4cb-43914267a731 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:14.118308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a2c5b863-ee03-467f-a4cb-43914267a731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:14.140387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd98cc-3404-4452-ad86-539fe5513045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:14.143039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd98cc-3404-4452-ad86-539fe5513045 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:14.143747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd98cc-3404-4452-ad86-539fe5513045 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:14.144211 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd98cc-3404-4452-ad86-539fe5513045 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3/users/2c0db5c1682b4326b65972f4d68903c2/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:14.147936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd98cc-3404-4452-ad86-539fe5513045 None admin] RBAC: Authorizing `identity:create_grant(project_id=77d2af586e494e72ba2b582af008f3a3, user_id=2c0db5c1682b4326b65972f4d68903c2, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:14.150200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd98cc-3404-4452-ad86-539fe5513045 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:14.175410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 130/256] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:09:13 2022] PUT /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3/users/2c0db5c1682b4326b65972f4d68903c2/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:09:14.233982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 127/257] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:14.342131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd98cc-3404-4452-ad86-539fe5513045 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:14.450133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd98cc-3404-4452-ad86-539fe5513045 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:14.490308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8ccad-ca9b-4578-a896-31907b04b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:14.490966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8ccad-ca9b-4578-a896-31907b04b5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:14.491241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8ccad-ca9b-4578-a896-31907b04b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:14.491534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8ccad-ca9b-4578-a896-31907b04b5f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:14.508544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8ccad-ca9b-4578-a896-31907b04b5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-19e8ccad-ca9b-4578-a896-31907b04b5f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:14.513986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:14.514855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:14.516065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 131/258] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:14.521198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5b863-ee03-467f-a4cb-43914267a731 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:14.597066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:14.659286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5b863-ee03-467f-a4cb-43914267a731 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:14.693607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4db73-73d5-489f-adbb-45a616585d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:14.694227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4db73-73d5-489f-adbb-45a616585d83 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:14.694506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4db73-73d5-489f-adbb-45a616585d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:14.694778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4db73-73d5-489f-adbb-45a616585d83 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:14.695472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4db73-73d5-489f-adbb-45a616585d83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:14.695774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4db73-73d5-489f-adbb-45a616585d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:14.697156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4db73-73d5-489f-adbb-45a616585d83 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:14.706136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 128/259] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:14.711591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8ccad-ca9b-4578-a896-31907b04b5f0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:14.741051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4db73-73d5-489f-adbb-45a616585d83 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:14.760043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:14.886219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8ccad-ca9b-4578-a896-31907b04b5f0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:14.900952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4db73-73d5-489f-adbb-45a616585d83 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:14.923023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:14.959624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ed890-08e9-47ae-a0f4-3b14a3ba20e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:14.960273 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ed890-08e9-47ae-a0f4-3b14a3ba20e4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:14.960554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ed890-08e9-47ae-a0f4-3b14a3ba20e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:14.960817 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ed890-08e9-47ae-a0f4-3b14a3ba20e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:14.963115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc160-05d3-4f07-b7c5-4bf94bf5e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:14.964047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc160-05d3-4f07-b7c5-4bf94bf5e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:14.964555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc160-05d3-4f07-b7c5-4bf94bf5e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:14.964961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc160-05d3-4f07-b7c5-4bf94bf5e3a3 None admin] PATH_INFO: `/v3/users/611b4a459a1f4889956fb469e4bfd9fe` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:14.968592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc160-05d3-4f07-b7c5-4bf94bf5e3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=611b4a459a1f4889956fb469e4bfd9fe)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:14.970416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc160-05d3-4f07-b7c5-4bf94bf5e3a3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:14.972647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 132/260] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:14 2022] GET /identity/v3/users/611b4a459a1f4889956fb469e4bfd9fe => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:14.972767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ed890-08e9-47ae-a0f4-3b14a3ba20e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-928ed890-08e9-47ae-a0f4-3b14a3ba20e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:14.978203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:14.979069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:14.979897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 129/261] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:14.981007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc160-05d3-4f07-b7c5-4bf94bf5e3a3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:14.989013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ed890-08e9-47ae-a0f4-3b14a3ba20e4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:15.132173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:15.136739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc160-05d3-4f07-b7c5-4bf94bf5e3a3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:15.180038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c905071-4440-4cb4-844e-3c4c61e20076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:15.180958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905071-4440-4cb4-844e-3c4c61e20076 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:15.181922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905071-4440-4cb4-844e-3c4c61e20076 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:15.182341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905071-4440-4cb4-844e-3c4c61e20076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:15.236607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ed890-08e9-47ae-a0f4-3b14a3ba20e4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:15.320572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c905071-4440-4cb4-844e-3c4c61e20076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:15.322145 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c905071-4440-4cb4-844e-3c4c61e20076 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:15.328823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae3e77-bc38-45e5-9330-a4d7f3a90739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:15.329447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3e77-bc38-45e5-9330-a4d7f3a90739 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:15.329722 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3e77-bc38-45e5-9330-a4d7f3a90739 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:15.329992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3e77-bc38-45e5-9330-a4d7f3a90739 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:15.331121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae3e77-bc38-45e5-9330-a4d7f3a90739 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:15.331452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae3e77-bc38-45e5-9330-a4d7f3a90739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:15.332832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae3e77-bc38-45e5-9330-a4d7f3a90739 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:15.350343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 130/262] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:15.357330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae3e77-bc38-45e5-9330-a4d7f3a90739 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:15.425967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:15.499052 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 133/263] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:09:15.499655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:15.505554 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c905071-4440-4cb4-844e-3c4c61e20076 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:15.519129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae3e77-bc38-45e5-9330-a4d7f3a90739 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:15.578921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dda99-69fb-43fc-b492-278dc9c3024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:15.579884 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dda99-69fb-43fc-b492-278dc9c3024d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:15.580346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dda99-69fb-43fc-b492-278dc9c3024d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:15.581008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dda99-69fb-43fc-b492-278dc9c3024d None admin] PATH_INFO: `/v3/users/611b4a459a1f4889956fb469e4bfd9fe` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:15.589437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090dda99-69fb-43fc-b492-278dc9c3024d None admin] RBAC: Authorizing `identity:get_user(user_id=611b4a459a1f4889956fb469e4bfd9fe)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:15.591296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090dda99-69fb-43fc-b492-278dc9c3024d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:15.593797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 131/264] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:15 2022] GET /identity/v3/users/611b4a459a1f4889956fb469e4bfd9fe => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:15.599518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dda99-69fb-43fc-b492-278dc9c3024d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:15.724408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c905071-4440-4cb4-844e-3c4c61e20076 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:15.782688 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dda99-69fb-43fc-b492-278dc9c3024d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:15.804218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:15.808087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3916cb7-5338-4020-9019-529aee137882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:15.810119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3916cb7-5338-4020-9019-529aee137882 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:15.810119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3916cb7-5338-4020-9019-529aee137882 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:15.810119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3916cb7-5338-4020-9019-529aee137882 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:15.815987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3916cb7-5338-4020-9019-529aee137882 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:15.817453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3916cb7-5338-4020-9019-529aee137882 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:15.819486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 134/265] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:15 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:15.825353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3916cb7-5338-4020-9019-529aee137882 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:15.837355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77c1fa-df51-4ac0-82dc-3a8d94367030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:15.838027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77c1fa-df51-4ac0-82dc-3a8d94367030 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:15.838302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77c1fa-df51-4ac0-82dc-3a8d94367030 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:15.838570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77c1fa-df51-4ac0-82dc-3a8d94367030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:15.980695 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77c1fa-df51-4ac0-82dc-3a8d94367030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:15.982466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77c1fa-df51-4ac0-82dc-3a8d94367030 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:15.992200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:16.084475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3916cb7-5338-4020-9019-529aee137882 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:16.148043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75c7a9-c5db-4adb-9bff-b1bdfe90813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:16.149554 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c7a9-c5db-4adb-9bff-b1bdfe90813e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:16.150020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c7a9-c5db-4adb-9bff-b1bdfe90813e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:16.150473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c7a9-c5db-4adb-9bff-b1bdfe90813e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:16.151538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75c7a9-c5db-4adb-9bff-b1bdfe90813e None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=77d2af586e494e72ba2b582af008f3a3, user.id=611b4a459a1f4889956fb469e4bfd9fe) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:16.152080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75c7a9-c5db-4adb-9bff-b1bdfe90813e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:16.153716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75c7a9-c5db-4adb-9bff-b1bdfe90813e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:16.166664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 135/266] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:15 2022] GET /identity/v3/role_assignments?user.id=611b4a459a1f4889956fb469e4bfd9fe&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 608 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:16.182039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 132/267] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:16.187807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75c7a9-c5db-4adb-9bff-b1bdfe90813e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:16.366538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75c7a9-c5db-4adb-9bff-b1bdfe90813e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:16.403805 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:16.409662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c3fbe-db8d-4c06-ba3d-97715fd8cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:16.410315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c3fbe-db8d-4c06-ba3d-97715fd8cb7d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:16.410797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c3fbe-db8d-4c06-ba3d-97715fd8cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:16.411043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c3fbe-db8d-4c06-ba3d-97715fd8cb7d None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:16.416817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c3fbe-db8d-4c06-ba3d-97715fd8cb7d None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:16.418264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c3fbe-db8d-4c06-ba3d-97715fd8cb7d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:16.420297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 136/268] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:16 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:16.426261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77c1fa-df51-4ac0-82dc-3a8d94367030 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:16.428562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:16.517575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10718ac-dac0-4253-b3ea-0cafb86509e2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:16.518293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10718ac-dac0-4253-b3ea-0cafb86509e2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:16.518791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10718ac-dac0-4253-b3ea-0cafb86509e2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:16.521808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 137/269] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:16.526130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f748ba-91d7-4f1e-9a4e-1b10793fe689 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:16.526633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f748ba-91d7-4f1e-9a4e-1b10793fe689 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:16.527089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f748ba-91d7-4f1e-9a4e-1b10793fe689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:16.559632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-35f748ba-91d7-4f1e-9a4e-1b10793fe689 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:16.561268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-35f748ba-91d7-4f1e-9a4e-1b10793fe689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:16.581477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77c1fa-df51-4ac0-82dc-3a8d94367030 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:16.645845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77ac57-4bd0-4dd0-a1dc-150d02138d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:16.646374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77ac57-4bd0-4dd0-a1dc-150d02138d8b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:16.646650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77ac57-4bd0-4dd0-a1dc-150d02138d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:16.646917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77ac57-4bd0-4dd0-a1dc-150d02138d8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:16.647682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77ac57-4bd0-4dd0-a1dc-150d02138d8b None admin] RBAC: Adding query filter params (role.id=4111136d5e114c4b9ca719aa39f4bc23, scope.project.id=77d2af586e494e72ba2b582af008f3a3, user.id=611b4a459a1f4889956fb469e4bfd9fe) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:16.647978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77ac57-4bd0-4dd0-a1dc-150d02138d8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:16.649772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77ac57-4bd0-4dd0-a1dc-150d02138d8b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:16.662998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 133/270] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:16 2022] GET /identity/v3/role_assignments?user.id=611b4a459a1f4889956fb469e4bfd9fe&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=4111136d5e114c4b9ca719aa39f4bc23 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:16.673039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8adf9d-10dc-4db1-b14f-e63dee9cda9e None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:16.673413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8adf9d-10dc-4db1-b14f-e63dee9cda9e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:16.673602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8adf9d-10dc-4db1-b14f-e63dee9cda9e None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:16.675497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 134/271] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:09:16.682485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd544d-cfd1-4ea8-9fe9-8a1c48754045 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:16.682485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd544d-cfd1-4ea8-9fe9-8a1c48754045 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:16.682485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd544d-cfd1-4ea8-9fe9-8a1c48754045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:16.684374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 138/272] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:16.701431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5bdd544d-cfd1-4ea8-9fe9-8a1c48754045 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:16.702628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5bdd544d-cfd1-4ea8-9fe9-8a1c48754045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:16.769048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:16.777257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 135/273] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:16.779942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09dc8-7cc9-4748-9be4-f4be3ff5874c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:16.780229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09dc8-7cc9-4748-9be4-f4be3ff5874c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:16.780503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09dc8-7cc9-4748-9be4-f4be3ff5874c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:16.782146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 139/274] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:16.787382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f2701-0f2e-4baf-ba81-0459e88675e5 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:16.787662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f2701-0f2e-4baf-ba81-0459e88675e5 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:16.787930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f2701-0f2e-4baf-ba81-0459e88675e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:16.817320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3f2f2701-0f2e-4baf-ba81-0459e88675e5 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:16.818878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3f2f2701-0f2e-4baf-ba81-0459e88675e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:16.913925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 136/275] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:17.087286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b09dc8-7cc9-4748-9be4-f4be3ff5874c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:17.094484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f2701-0f2e-4baf-ba81-0459e88675e5 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:17.217114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f2701-0f2e-4baf-ba81-0459e88675e5 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:17.221896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b09dc8-7cc9-4748-9be4-f4be3ff5874c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:17.247162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:17.251084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:17.257187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c37766-eab8-4982-8c2a-0fd1b5908182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:17.257824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c37766-eab8-4982-8c2a-0fd1b5908182 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:17.258101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c37766-eab8-4982-8c2a-0fd1b5908182 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:17.258369 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c37766-eab8-4982-8c2a-0fd1b5908182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:17.259323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d7744-01ab-4fe7-9b8b-0d33750700b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:17.259491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c37766-eab8-4982-8c2a-0fd1b5908182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:17.259949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d7744-01ab-4fe7-9b8b-0d33750700b9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:17.260223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d7744-01ab-4fe7-9b8b-0d33750700b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:17.260491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d7744-01ab-4fe7-9b8b-0d33750700b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:17.260964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c37766-eab8-4982-8c2a-0fd1b5908182 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:17.262536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 137/276] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:17.263678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced878-2bb7-45a1-b7ca-4d78efc1c996 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:17.263958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced878-2bb7-45a1-b7ca-4d78efc1c996 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:17.264235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced878-2bb7-45a1-b7ca-4d78efc1c996 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:17.265433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 138/277] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:17.266130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcced878-2bb7-45a1-b7ca-4d78efc1c996 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:17.274109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d7744-01ab-4fe7-9b8b-0d33750700b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-202d7744-01ab-4fe7-9b8b-0d33750700b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:17.280289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:17.281278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:17.282056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 140/278] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:17.282699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d7744-01ab-4fe7-9b8b-0d33750700b9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:17.371795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcced878-2bb7-45a1-b7ca-4d78efc1c996 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:17.381466 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d7744-01ab-4fe7-9b8b-0d33750700b9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:17.409029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77006b7e-d668-4ed1-8537-694fded662a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:17.409652 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77006b7e-d668-4ed1-8537-694fded662a7 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:17.409926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77006b7e-d668-4ed1-8537-694fded662a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:17.410168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77006b7e-d668-4ed1-8537-694fded662a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:17.417040 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffd957-6a93-472a-85ae-30311c96dea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:17.417683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd957-6a93-472a-85ae-30311c96dea9 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:17.417964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd957-6a93-472a-85ae-30311c96dea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:17.418240 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd957-6a93-472a-85ae-30311c96dea9 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:17.418895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffd957-6a93-472a-85ae-30311c96dea9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:17.420374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffd957-6a93-472a-85ae-30311c96dea9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:17.421055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77006b7e-d668-4ed1-8537-694fded662a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-77006b7e-d668-4ed1-8537-694fded662a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:17.426033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:17.427347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:17.428131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 139/279] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:17.430064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685e2a1-b2f9-47f4-8d5d-83a60b90b0d4 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:17.430064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685e2a1-b2f9-47f4-8d5d-83a60b90b0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:17.430064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685e2a1-b2f9-47f4-8d5d-83a60b90b0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:17.444211 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 141/280] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:09:17 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:09:17.444795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffd957-6a93-472a-85ae-30311c96dea9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:17.447169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2685e2a1-b2f9-47f4-8d5d-83a60b90b0d4 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:17.448411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2685e2a1-b2f9-47f4-8d5d-83a60b90b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:17.510537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:17.522274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:17.547288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 140/281] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:17.547288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685e2a1-b2f9-47f4-8d5d-83a60b90b0d4 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:17.584661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffd957-6a93-472a-85ae-30311c96dea9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:17.629754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1457b-d7dc-43bf-bc53-b9a5c1f95fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:17.630487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1457b-d7dc-43bf-bc53-b9a5c1f95fad None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:17.630872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1457b-d7dc-43bf-bc53-b9a5c1f95fad None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:17.631217 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1457b-d7dc-43bf-bc53-b9a5c1f95fad None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:17.631925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1457b-d7dc-43bf-bc53-b9a5c1f95fad None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:17.632229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1457b-d7dc-43bf-bc53-b9a5c1f95fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:17.633731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1457b-d7dc-43bf-bc53-b9a5c1f95fad None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:17.644600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 142/282] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:17.650155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1457b-d7dc-43bf-bc53-b9a5c1f95fad None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:17.675461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685e2a1-b2f9-47f4-8d5d-83a60b90b0d4 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:17.722406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ecda9-6767-498f-9214-8d0cebda30d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:17.723110 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ecda9-6767-498f-9214-8d0cebda30d3 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:17.724142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ecda9-6767-498f-9214-8d0cebda30d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:17.724142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ecda9-6767-498f-9214-8d0cebda30d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:17.724590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ecda9-6767-498f-9214-8d0cebda30d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:17.726383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ecda9-6767-498f-9214-8d0cebda30d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:17.728888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ecda9-6767-498f-9214-8d0cebda30d3 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:17.740184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 141/283] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:17.746822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ecda9-6767-498f-9214-8d0cebda30d3 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:17.787146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1457b-d7dc-43bf-bc53-b9a5c1f95fad None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:17.795463 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:17.806470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:17.833688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fc710-7450-4135-aa2a-15a9eb424b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:17.834350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fc710-7450-4135-aa2a-15a9eb424b40 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:17.834631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fc710-7450-4135-aa2a-15a9eb424b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:17.834907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fc710-7450-4135-aa2a-15a9eb424b40 None admin] PATH_INFO: `/v3/users/d41b17d0a05c4abab6f5bc346657fad1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:17.850372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fc710-7450-4135-aa2a-15a9eb424b40 None admin] RBAC: Authorizing `identity:get_user(user_id=d41b17d0a05c4abab6f5bc346657fad1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:17.851876 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fc710-7450-4135-aa2a-15a9eb424b40 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:17.853593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 143/284] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:17 2022] GET /identity/v3/users/d41b17d0a05c4abab6f5bc346657fad1 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:17.856035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fc710-7450-4135-aa2a-15a9eb424b40 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:17.868637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ecda9-6767-498f-9214-8d0cebda30d3 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:17.906367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a71e27-1831-49b3-8c1d-4ea5b83045a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:17.907385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a71e27-1831-49b3-8c1d-4ea5b83045a2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:17.907840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a71e27-1831-49b3-8c1d-4ea5b83045a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:17.908341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a71e27-1831-49b3-8c1d-4ea5b83045a2 None admin] PATH_INFO: `/v3/users/af69768eb7284470beb96357a71a0b3d` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:17.909668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a71e27-1831-49b3-8c1d-4ea5b83045a2 None admin] RBAC: Authorizing `identity:get_user(user_id=af69768eb7284470beb96357a71a0b3d)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:17.911348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a71e27-1831-49b3-8c1d-4ea5b83045a2 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:17.913412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 142/285] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:17 2022] GET /identity/v3/users/af69768eb7284470beb96357a71a0b3d => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:17.914354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a71e27-1831-49b3-8c1d-4ea5b83045a2 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:17.991497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fc710-7450-4135-aa2a-15a9eb424b40 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:18.027523 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a71e27-1831-49b3-8c1d-4ea5b83045a2 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:18.040074 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a827a-149d-4339-b166-a5b0c2b82c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:18.041056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a827a-149d-4339-b166-a5b0c2b82c30 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:18.041402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a827a-149d-4339-b166-a5b0c2b82c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:18.041741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a827a-149d-4339-b166-a5b0c2b82c30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:18.044370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:18.058092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a827a-149d-4339-b166-a5b0c2b82c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-132a827a-149d-4339-b166-a5b0c2b82c30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:18.065286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:18.066267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:18.067058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 144/286] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:18.071919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a827a-149d-4339-b166-a5b0c2b82c30 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:18.074627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ec3e1-5a53-4484-822e-8a9547896010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:18.075284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ec3e1-5a53-4484-822e-8a9547896010 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:18.075602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ec3e1-5a53-4484-822e-8a9547896010 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:18.075876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ec3e1-5a53-4484-822e-8a9547896010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:18.076765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ec3e1-5a53-4484-822e-8a9547896010 None admin] RBAC: Adding query filter params (role.id=b6a39390284c4cef8e11ad0888016b38, user.id=d41b17d0a05c4abab6f5bc346657fad1, scope.system=all) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:18.076936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ec3e1-5a53-4484-822e-8a9547896010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:18.078801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ec3e1-5a53-4484-822e-8a9547896010 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:18.084194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 143/287] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Sep 3 01:09:17 2022] GET /identity/v3/role_assignments?user.id=d41b17d0a05c4abab6f5bc346657fad1&scope.system=all&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:18.085161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ec3e1-5a53-4484-822e-8a9547896010 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:18.108079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:18.212989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a827a-149d-4339-b166-a5b0c2b82c30 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:18.221586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ec3e1-5a53-4484-822e-8a9547896010 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:18.259984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de089803-25ab-42b0-976f-bcc3596a5302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:18.261677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de089803-25ab-42b0-976f-bcc3596a5302 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:18.262154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de089803-25ab-42b0-976f-bcc3596a5302 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:18.262636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de089803-25ab-42b0-976f-bcc3596a5302 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:18.264071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de089803-25ab-42b0-976f-bcc3596a5302 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:18.265745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de089803-25ab-42b0-976f-bcc3596a5302 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:18.269780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 145/288] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:18 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:18.280326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de089803-25ab-42b0-976f-bcc3596a5302 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:18.289953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda541e-7008-452f-9957-6b608af1a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:18.290703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda541e-7008-452f-9957-6b608af1a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:18.290987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda541e-7008-452f-9957-6b608af1a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:18.291286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda541e-7008-452f-9957-6b608af1a5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:18.291992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda541e-7008-452f-9957-6b608af1a5d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:18.292298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda541e-7008-452f-9957-6b608af1a5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:18.293763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda541e-7008-452f-9957-6b608af1a5d8 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:18.303502 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 144/289] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:18.309109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda541e-7008-452f-9957-6b608af1a5d8 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:18.355213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:18.421589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda541e-7008-452f-9957-6b608af1a5d8 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:18.429890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:18.439013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de089803-25ab-42b0-976f-bcc3596a5302 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:18.457954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a50dd-1e38-4928-9d18-1a59ed2f77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:18.458638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a50dd-1e38-4928-9d18-1a59ed2f77c4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:18.459097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a50dd-1e38-4928-9d18-1a59ed2f77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:18.459313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a50dd-1e38-4928-9d18-1a59ed2f77c4 None admin] PATH_INFO: `/v3/users/2c0db5c1682b4326b65972f4d68903c2` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:18.460406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a50dd-1e38-4928-9d18-1a59ed2f77c4 None admin] RBAC: Authorizing `identity:get_user(user_id=2c0db5c1682b4326b65972f4d68903c2)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:18.461934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a50dd-1e38-4928-9d18-1a59ed2f77c4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:18.464009 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 145/290] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:18 2022] GET /identity/v3/users/2c0db5c1682b4326b65972f4d68903c2 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:18.469659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a50dd-1e38-4928-9d18-1a59ed2f77c4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:18.477371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff180cb-422f-411d-b57e-6af082489488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:18.478327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff180cb-422f-411d-b57e-6af082489488 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:18.478816 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff180cb-422f-411d-b57e-6af082489488 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:18.479294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff180cb-422f-411d-b57e-6af082489488 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3/users/af69768eb7284470beb96357a71a0b3d/roles/aad7b5d260224bf496f850a91a555d72` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:18.481777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff180cb-422f-411d-b57e-6af082489488 None admin] RBAC: Authorizing `identity:create_grant(project_id=77d2af586e494e72ba2b582af008f3a3, user_id=af69768eb7284470beb96357a71a0b3d, role_id=aad7b5d260224bf496f850a91a555d72)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:18.483465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff180cb-422f-411d-b57e-6af082489488 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:18.510731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 146/291] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:09:18 2022] PUT /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3/users/af69768eb7284470beb96357a71a0b3d/roles/aad7b5d260224bf496f850a91a555d72 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:18.580670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a50dd-1e38-4928-9d18-1a59ed2f77c4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:18.590381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:18.617916 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b87a-82b7-4e8b-8426-843cbf17a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:18.618561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b87a-82b7-4e8b-8426-843cbf17a913 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:18.618849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b87a-82b7-4e8b-8426-843cbf17a913 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:18.619123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b87a-82b7-4e8b-8426-843cbf17a913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:18.695095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b87a-82b7-4e8b-8426-843cbf17a913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:18.696634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b87a-82b7-4e8b-8426-843cbf17a913 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:18.802486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 146/292] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:09:18.808291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff180cb-422f-411d-b57e-6af082489488 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:18.912587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff180cb-422f-411d-b57e-6af082489488 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:18.969147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a296e55-663f-4ec8-afa0-ef3e00a3baf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:18.969807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296e55-663f-4ec8-afa0-ef3e00a3baf6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:18.970150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296e55-663f-4ec8-afa0-ef3e00a3baf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:18.970426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296e55-663f-4ec8-afa0-ef3e00a3baf6 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:18.975995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a296e55-663f-4ec8-afa0-ef3e00a3baf6 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:18.977455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a296e55-663f-4ec8-afa0-ef3e00a3baf6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:18.979138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 147/293] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:18 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:18.985497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b87a-82b7-4e8b-8426-843cbf17a913 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:18.998769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:19.113090 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b87a-82b7-4e8b-8426-843cbf17a913 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:19.152023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa20821-7514-4fe4-b80a-a6e45340093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:19.152969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa20821-7514-4fe4-b80a-a6e45340093b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:19.153464 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa20821-7514-4fe4-b80a-a6e45340093b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:19.153923 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa20821-7514-4fe4-b80a-a6e45340093b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:19.154829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa20821-7514-4fe4-b80a-a6e45340093b None admin] RBAC: Adding query filter params (role.id=b6a39390284c4cef8e11ad0888016b38, scope.project.id=77d2af586e494e72ba2b582af008f3a3, user.id=2c0db5c1682b4326b65972f4d68903c2) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:19.155354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa20821-7514-4fe4-b80a-a6e45340093b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:19.156986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa20821-7514-4fe4-b80a-a6e45340093b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:19.163578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 147/294] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:18 2022] GET /identity/v3/role_assignments?user.id=2c0db5c1682b4326b65972f4d68903c2&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:19.868876 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc903-14df-4c21-a015-2483eced738f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:19.869391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc903-14df-4c21-a015-2483eced738f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:19.869391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc903-14df-4c21-a015-2483eced738f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:19.871026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 148/295] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:19.876518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1e90-6061-47db-92fb-5a2a3bda920a None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:19.877067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1e90-6061-47db-92fb-5a2a3bda920a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:19.877188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1e90-6061-47db-92fb-5a2a3bda920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:19.897965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab49e10-a1aa-442f-9848-a9991d1d1a88 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:19.898262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab49e10-a1aa-442f-9848-a9991d1d1a88 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:19.898496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab49e10-a1aa-442f-9848-a9991d1d1a88 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:19.899615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a80f1e90-6061-47db-92fb-5a2a3bda920a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:19.900212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 149/296] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:09:19.901365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a80f1e90-6061-47db-92fb-5a2a3bda920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:19.905642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805b3af-b3f8-476b-a7a6-45a6097ebd0b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:19.905927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805b3af-b3f8-476b-a7a6-45a6097ebd0b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:19.906201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805b3af-b3f8-476b-a7a6-45a6097ebd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:19.927675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1805b3af-b3f8-476b-a7a6-45a6097ebd0b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:19.928955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1805b3af-b3f8-476b-a7a6-45a6097ebd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:19.951449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:19.986921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 148/297] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:20.015280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 150/298] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:20.250206 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f1e90-6061-47db-92fb-5a2a3bda920a None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:20.252914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:20.286847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805b3af-b3f8-476b-a7a6-45a6097ebd0b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:20.362396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f1e90-6061-47db-92fb-5a2a3bda920a None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:20.390965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805b3af-b3f8-476b-a7a6-45a6097ebd0b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:20.401107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ad903-bb43-4b3d-8ce6-649a5705c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:20.401739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ad903-bb43-4b3d-8ce6-649a5705c057 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:20.402016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ad903-bb43-4b3d-8ce6-649a5705c057 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:20.402284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ad903-bb43-4b3d-8ce6-649a5705c057 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:20.403387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ad903-bb43-4b3d-8ce6-649a5705c057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:20.404838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ad903-bb43-4b3d-8ce6-649a5705c057 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:20.406496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 149/299] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:20.407539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58177-a2f0-4bf9-864d-20ca7691e899 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:20.407816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58177-a2f0-4bf9-864d-20ca7691e899 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:20.408159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58177-a2f0-4bf9-864d-20ca7691e899 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:20.409471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 150/300] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:20.416616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58177-a2f0-4bf9-864d-20ca7691e899 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:20.428517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83080c-760f-437c-94de-3a2f80e19097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:20.429191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83080c-760f-437c-94de-3a2f80e19097 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:20.429475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83080c-760f-437c-94de-3a2f80e19097 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:20.429744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83080c-760f-437c-94de-3a2f80e19097 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:20.441547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83080c-760f-437c-94de-3a2f80e19097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-aa83080c-760f-437c-94de-3a2f80e19097 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:20.446511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:20.447878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:20.448667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 151/301] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:20.453580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db646e72-ee58-4cb2-b11e-8f049e04a647 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:20.453860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db646e72-ee58-4cb2-b11e-8f049e04a647 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:20.454135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db646e72-ee58-4cb2-b11e-8f049e04a647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:20.474035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-db646e72-ee58-4cb2-b11e-8f049e04a647 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:20.475228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-db646e72-ee58-4cb2-b11e-8f049e04a647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:20.479751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:20.492896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:20.526126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58177-a2f0-4bf9-864d-20ca7691e899 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:20.558909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 152/302] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:20.559840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db646e72-ee58-4cb2-b11e-8f049e04a647 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:20.571479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f80e38-68f2-4f50-ba2b-976477ce3907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:20.572452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f80e38-68f2-4f50-ba2b-976477ce3907 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:20.572934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f80e38-68f2-4f50-ba2b-976477ce3907 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:20.573417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f80e38-68f2-4f50-ba2b-976477ce3907 None admin] PATH_INFO: `/v3/groups` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:20.574400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f80e38-68f2-4f50-ba2b-976477ce3907 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:20.576232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f80e38-68f2-4f50-ba2b-976477ce3907 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:20.607550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 151/303] 10.222.0.39 () {60 vars in 1134 bytes} [Sat Sep 3 01:09:20 2022] POST /identity/v3/groups => generated 229 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:09:20.693610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db646e72-ee58-4cb2-b11e-8f049e04a647 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:20.731887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d823e-0657-4ad9-a502-0eae202823e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:20.732561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d823e-0657-4ad9-a502-0eae202823e1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:20.732840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d823e-0657-4ad9-a502-0eae202823e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:20.733111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d823e-0657-4ad9-a502-0eae202823e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:20.733839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d823e-0657-4ad9-a502-0eae202823e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:20.734141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d823e-0657-4ad9-a502-0eae202823e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:20.735548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d823e-0657-4ad9-a502-0eae202823e1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:20.745415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 153/304] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:20.750776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f80e38-68f2-4f50-ba2b-976477ce3907 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:20.845834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d823e-0657-4ad9-a502-0eae202823e1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:20.848811 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:20.865484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f80e38-68f2-4f50-ba2b-976477ce3907 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:20.895191 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:20.902038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d0a95-be66-4fe8-9012-94778baad250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:20.902747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d0a95-be66-4fe8-9012-94778baad250 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:20.903590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d0a95-be66-4fe8-9012-94778baad250 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:20.904115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d0a95-be66-4fe8-9012-94778baad250 None admin] PATH_INFO: `/v3/users/d30146246f9949aaae317ab6d1795bd6` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:20.921397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d0a95-be66-4fe8-9012-94778baad250 None admin] RBAC: Authorizing `identity:get_user(user_id=d30146246f9949aaae317ab6d1795bd6)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:20.922928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d0a95-be66-4fe8-9012-94778baad250 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:20.925084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 152/305] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:20 2022] GET /identity/v3/users/d30146246f9949aaae317ab6d1795bd6 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:20.931189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d0a95-be66-4fe8-9012-94778baad250 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:20.990583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d823e-0657-4ad9-a502-0eae202823e1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:21.030638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d615e-1014-49ea-9953-60cb33f45f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:21.031549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d615e-1014-49ea-9953-60cb33f45f3a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:21.031975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d615e-1014-49ea-9953-60cb33f45f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:21.032335 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d615e-1014-49ea-9953-60cb33f45f3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:21.034556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d0a95-be66-4fe8-9012-94778baad250 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:21.043149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d615e-1014-49ea-9953-60cb33f45f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8d6d615e-1014-49ea-9953-60cb33f45f3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:21.049474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:21.050613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:21.051588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 154/306] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:21.052311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8ab8d-9c66-4a1e-b687-753a489d8cd3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:21.052440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8ab8d-9c66-4a1e-b687-753a489d8cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:21.052838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8ab8d-9c66-4a1e-b687-753a489d8cd3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:21.054276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 155/307] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:21.059115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8ab8d-9c66-4a1e-b687-753a489d8cd3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:21.077953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83810bfe-d947-4b9e-a5c8-6c74c0d09f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:21.078852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83810bfe-d947-4b9e-a5c8-6c74c0d09f68 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:21.079311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83810bfe-d947-4b9e-a5c8-6c74c0d09f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:21.079727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83810bfe-d947-4b9e-a5c8-6c74c0d09f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:21.080793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83810bfe-d947-4b9e-a5c8-6c74c0d09f68 None admin] RBAC: Adding query filter params (role.id=aad7b5d260224bf496f850a91a555d72, user.id=d30146246f9949aaae317ab6d1795bd6, scope.system=all) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:21.081263 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83810bfe-d947-4b9e-a5c8-6c74c0d09f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:21.082952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83810bfe-d947-4b9e-a5c8-6c74c0d09f68 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:21.088607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 153/308] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Sep 3 01:09:20 2022] GET /identity/v3/role_assignments?user.id=d30146246f9949aaae317ab6d1795bd6&scope.system=all&role.id=aad7b5d260224bf496f850a91a555d72 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:21.090043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91b1db-5691-41e6-af4e-458ff8c7b64e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:21.090330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91b1db-5691-41e6-af4e-458ff8c7b64e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:21.090602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91b1db-5691-41e6-af4e-458ff8c7b64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:21.113266 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ab91b1db-5691-41e6-af4e-458ff8c7b64e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:21.114629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ab91b1db-5691-41e6-af4e-458ff8c7b64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:21.143546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:21.173723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:21.202173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 154/309] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:21.210497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8ab8d-9c66-4a1e-b687-753a489d8cd3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:21.251089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdf6f5-77ad-4564-995c-206bb4835df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:21.251956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdf6f5-77ad-4564-995c-206bb4835df1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:21.252243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdf6f5-77ad-4564-995c-206bb4835df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:21.252518 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdf6f5-77ad-4564-995c-206bb4835df1 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:21.253490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdf6f5-77ad-4564-995c-206bb4835df1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:21.253610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdf6f5-77ad-4564-995c-206bb4835df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:21.265693 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdf6f5-77ad-4564-995c-206bb4835df1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:21.278955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 156/310] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:21.284643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91b1db-5691-41e6-af4e-458ff8c7b64e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:21.392673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91b1db-5691-41e6-af4e-458ff8c7b64e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:21.430467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46f435-eb10-4d04-b6e1-86725a61f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:21.431100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f435-eb10-4d04-b6e1-86725a61f305 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:21.431398 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f435-eb10-4d04-b6e1-86725a61f305 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:21.431669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f435-eb10-4d04-b6e1-86725a61f305 None admin] PATH_INFO: `/v3/users/d41b17d0a05c4abab6f5bc346657fad1` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:21.432774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46f435-eb10-4d04-b6e1-86725a61f305 None admin] RBAC: Authorizing `identity:get_user(user_id=d41b17d0a05c4abab6f5bc346657fad1)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:21.434272 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46f435-eb10-4d04-b6e1-86725a61f305 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:21.436171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 155/311] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:21 2022] GET /identity/v3/users/d41b17d0a05c4abab6f5bc346657fad1 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:21.442461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdf6f5-77ad-4564-995c-206bb4835df1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:21.502485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46f435-eb10-4d04-b6e1-86725a61f305 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:21.553982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdf6f5-77ad-4564-995c-206bb4835df1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:21.571855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:21.580196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:21.592637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e37f0c-0852-48f9-854a-86c7c9d7d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:21.593506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e37f0c-0852-48f9-854a-86c7c9d7d010 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:21.593954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e37f0c-0852-48f9-854a-86c7c9d7d010 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:21.594364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e37f0c-0852-48f9-854a-86c7c9d7d010 None admin] PATH_INFO: `/v3/system/users/d41b17d0a05c4abab6f5bc346657fad1/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:21.596292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e37f0c-0852-48f9-854a-86c7c9d7d010 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d41b17d0a05c4abab6f5bc346657fad1, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:21.597920 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e37f0c-0852-48f9-854a-86c7c9d7d010 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:21.613790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46f435-eb10-4d04-b6e1-86725a61f305 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:21.614244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 157/312] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Sep 3 01:09:21 2022] PUT /identity/v3/system/users/d41b17d0a05c4abab6f5bc346657fad1/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:21.656757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef975ec-1b0a-47ea-9928-20cda320b623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:21.657561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef975ec-1b0a-47ea-9928-20cda320b623 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:21.657839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef975ec-1b0a-47ea-9928-20cda320b623 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:21.658198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef975ec-1b0a-47ea-9928-20cda320b623 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:21.672189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef975ec-1b0a-47ea-9928-20cda320b623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-aef975ec-1b0a-47ea-9928-20cda320b623 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:21.678529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:21.679514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:21.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 156/313] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:21.687723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e37f0c-0852-48f9-854a-86c7c9d7d010 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:21.801069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e37f0c-0852-48f9-854a-86c7c9d7d010 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:21.838127 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83dd3b-8313-4e35-87fa-caf4cff39a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:21.839097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83dd3b-8313-4e35-87fa-caf4cff39a34 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:21.839616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83dd3b-8313-4e35-87fa-caf4cff39a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:21.840100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83dd3b-8313-4e35-87fa-caf4cff39a34 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:21.840978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83dd3b-8313-4e35-87fa-caf4cff39a34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:21.841473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83dd3b-8313-4e35-87fa-caf4cff39a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:21.843104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83dd3b-8313-4e35-87fa-caf4cff39a34 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:21.856941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 158/314] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:21.858545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef975ec-1b0a-47ea-9928-20cda320b623 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:21.961678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef975ec-1b0a-47ea-9928-20cda320b623 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:21.973729 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:21.998515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210db21-4122-41d1-98c2-b2986a4aa8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:21.999582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210db21-4122-41d1-98c2-b2986a4aa8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:22.000067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210db21-4122-41d1-98c2-b2986a4aa8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:22.000554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210db21-4122-41d1-98c2-b2986a4aa8e3 None admin] PATH_INFO: `/v3/users/af69768eb7284470beb96357a71a0b3d` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:22.001938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210db21-4122-41d1-98c2-b2986a4aa8e3 None admin] RBAC: Authorizing `identity:get_user(user_id=af69768eb7284470beb96357a71a0b3d)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:22.003941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210db21-4122-41d1-98c2-b2986a4aa8e3 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:22.010529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 157/315] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:21 2022] GET /identity/v3/users/af69768eb7284470beb96357a71a0b3d => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:22.012172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83dd3b-8313-4e35-87fa-caf4cff39a34 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:22.065048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:22.123853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83dd3b-8313-4e35-87fa-caf4cff39a34 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:22.159577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ce8d9-a820-495d-afc9-f9f9f1d88a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:22.160441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ce8d9-a820-495d-afc9-f9f9f1d88a64 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:22.160855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ce8d9-a820-495d-afc9-f9f9f1d88a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:22.161258 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ce8d9-a820-495d-afc9-f9f9f1d88a64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:22.238057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ce8d9-a820-495d-afc9-f9f9f1d88a64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:22.239801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ce8d9-a820-495d-afc9-f9f9f1d88a64 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:22.292173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:22.343895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 159/316] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:22.352716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210db21-4122-41d1-98c2-b2986a4aa8e3 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:22.450860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210db21-4122-41d1-98c2-b2986a4aa8e3 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:22.484696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c98a8-75fa-4997-840b-bb6e6ce4b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:22.485334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c98a8-75fa-4997-840b-bb6e6ce4b681 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:22.485616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c98a8-75fa-4997-840b-bb6e6ce4b681 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:22.485890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c98a8-75fa-4997-840b-bb6e6ce4b681 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:22.487052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c98a8-75fa-4997-840b-bb6e6ce4b681 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:22.488547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c98a8-75fa-4997-840b-bb6e6ce4b681 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:22.495139 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 158/317] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:22 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:22.496544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ce8d9-a820-495d-afc9-f9f9f1d88a64 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:22.601611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ce8d9-a820-495d-afc9-f9f9f1d88a64 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:22.636008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec328f17-617e-4851-b43d-52f123ed0cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:22.636622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328f17-617e-4851-b43d-52f123ed0cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:22.636900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328f17-617e-4851-b43d-52f123ed0cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:22.637169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328f17-617e-4851-b43d-52f123ed0cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:22.637899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec328f17-617e-4851-b43d-52f123ed0cb2 None admin] RBAC: Adding query filter params (role.id=aad7b5d260224bf496f850a91a555d72, scope.project.id=77d2af586e494e72ba2b582af008f3a3, user.id=af69768eb7284470beb96357a71a0b3d) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:22.638200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec328f17-617e-4851-b43d-52f123ed0cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:22.639654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec328f17-617e-4851-b43d-52f123ed0cb2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:22.646178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 160/318] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:22 2022] GET /identity/v3/role_assignments?user.id=af69768eb7284470beb96357a71a0b3d&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=aad7b5d260224bf496f850a91a555d72 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:22.648242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a03a3-0ff5-48ea-b0b3-b37cc7ed97bb None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:22.648538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a03a3-0ff5-48ea-b0b3-b37cc7ed97bb None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:22.648795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a03a3-0ff5-48ea-b0b3-b37cc7ed97bb None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:22.650397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 159/319] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:22.656165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8dc02-eb7a-4947-b222-952adde5bd7e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:22.656466 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8dc02-eb7a-4947-b222-952adde5bd7e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:22.656719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8dc02-eb7a-4947-b222-952adde5bd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:22.676540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4fe8dc02-eb7a-4947-b222-952adde5bd7e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:22.677770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4fe8dc02-eb7a-4947-b222-952adde5bd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:22.689025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:22.754235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 161/320] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:23.017295 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a03a3-0ff5-48ea-b0b3-b37cc7ed97bb None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:23.069017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:23.125990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a03a3-0ff5-48ea-b0b3-b37cc7ed97bb None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:23.142401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cf701-2e33-4e0c-b28f-0ba17c35fe36 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:23.142951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cf701-2e33-4e0c-b28f-0ba17c35fe36 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:23.143025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cf701-2e33-4e0c-b28f-0ba17c35fe36 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:23.144393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 162/321] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:23.149304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce64600-a1e3-4c7e-ba18-f0b778d26a0b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:23.149578 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce64600-a1e3-4c7e-ba18-f0b778d26a0b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:23.149846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce64600-a1e3-4c7e-ba18-f0b778d26a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:23.161121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8add1-207b-495e-a308-d972b46409c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:23.161760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8add1-207b-495e-a308-d972b46409c2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:23.162039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8add1-207b-495e-a308-d972b46409c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:23.162309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8add1-207b-495e-a308-d972b46409c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:23.163419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8add1-207b-495e-a308-d972b46409c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:23.164863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8add1-207b-495e-a308-d972b46409c2 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:23.166584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 160/322] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:23.168020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1ce64600-a1e3-4c7e-ba18-f0b778d26a0b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:23.169193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1ce64600-a1e3-4c7e-ba18-f0b778d26a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:23.171928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8add1-207b-495e-a308-d972b46409c2 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:23.240628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 163/323] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:23.284298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8add1-207b-495e-a308-d972b46409c2 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:23.298452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:23.319728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb26a57-3cc9-49c2-9999-4c59f75d74bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:23.320335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26a57-3cc9-49c2-9999-4c59f75d74bd None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:23.320608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26a57-3cc9-49c2-9999-4c59f75d74bd None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:23.320873 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26a57-3cc9-49c2-9999-4c59f75d74bd None admin] PATH_INFO: `/v3/groups` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:23.321491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb26a57-3cc9-49c2-9999-4c59f75d74bd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:23.322933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb26a57-3cc9-49c2-9999-4c59f75d74bd None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:23.339551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 161/324] 10.222.0.39 () {60 vars in 1134 bytes} [Sat Sep 3 01:09:23 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:09:23.505292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce64600-a1e3-4c7e-ba18-f0b778d26a0b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:23.583129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:23.610765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce64600-a1e3-4c7e-ba18-f0b778d26a0b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:23.642590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e592eb-a2da-4320-925b-f338ac187fad None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:23.643131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e592eb-a2da-4320-925b-f338ac187fad None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:23.643483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e592eb-a2da-4320-925b-f338ac187fad None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:23.645227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 162/325] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:09:23.649677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404fbbf-91ff-461a-a351-477efadbf711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:23.650331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404fbbf-91ff-461a-a351-477efadbf711 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:23.650606 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404fbbf-91ff-461a-a351-477efadbf711 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:23.650875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404fbbf-91ff-461a-a351-477efadbf711 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:23.650969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004a0f3-9f10-494a-9003-13c8cbc03397 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:23.651203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004a0f3-9f10-494a-9003-13c8cbc03397 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:23.651851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004a0f3-9f10-494a-9003-13c8cbc03397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:23.662093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404fbbf-91ff-461a-a351-477efadbf711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5404fbbf-91ff-461a-a351-477efadbf711 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:23.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:23.668037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:23.669242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 164/326] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:23.671539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6004a0f3-9f10-494a-9003-13c8cbc03397 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:23.672730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6004a0f3-9f10-494a-9003-13c8cbc03397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:23.674842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404fbbf-91ff-461a-a351-477efadbf711 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:23.745264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 163/327] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:23.787070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404fbbf-91ff-461a-a351-477efadbf711 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:23.822765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ebef0-4b18-4448-b43a-b49f6e1d9e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:23.823454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ebef0-4b18-4448-b43a-b49f6e1d9e48 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:23.823726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ebef0-4b18-4448-b43a-b49f6e1d9e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:23.823988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ebef0-4b18-4448-b43a-b49f6e1d9e48 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:23.824700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ebef0-4b18-4448-b43a-b49f6e1d9e48 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:23.824994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ebef0-4b18-4448-b43a-b49f6e1d9e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:23.826431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ebef0-4b18-4448-b43a-b49f6e1d9e48 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:23.827899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:23.837345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 165/328] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:23.844713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004a0f3-9f10-494a-9003-13c8cbc03397 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:23.963601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004a0f3-9f10-494a-9003-13c8cbc03397 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:23.965949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:24.006772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aa868-2fee-42cf-9e04-a7161b2e4cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:24.007452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aa868-2fee-42cf-9e04-a7161b2e4cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:24.007730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aa868-2fee-42cf-9e04-a7161b2e4cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:24.008002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aa868-2fee-42cf-9e04-a7161b2e4cc3 None admin] PATH_INFO: `/v3/users/d30146246f9949aaae317ab6d1795bd6` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:24.009128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1aa868-2fee-42cf-9e04-a7161b2e4cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=d30146246f9949aaae317ab6d1795bd6)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:24.010579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1aa868-2fee-42cf-9e04-a7161b2e4cc3 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:24.012194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 164/329] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:23 2022] GET /identity/v3/users/d30146246f9949aaae317ab6d1795bd6 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:24.018260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ebef0-4b18-4448-b43a-b49f6e1d9e48 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:24.039532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aa868-2fee-42cf-9e04-a7161b2e4cc3 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:24.155890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ebef0-4b18-4448-b43a-b49f6e1d9e48 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:24.162819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aa868-2fee-42cf-9e04-a7161b2e4cc3 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:24.208556 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9e609-a334-4bca-ae86-84f7b2731cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:24.209550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9e609-a334-4bca-ae86-84f7b2731cb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:24.210253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9e609-a334-4bca-ae86-84f7b2731cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:24.210602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9e609-a334-4bca-ae86-84f7b2731cb9 None admin] PATH_INFO: `/v3/system/users/d30146246f9949aaae317ab6d1795bd6/roles/aad7b5d260224bf496f850a91a555d72` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:24.212448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9e609-a334-4bca-ae86-84f7b2731cb9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d30146246f9949aaae317ab6d1795bd6, role_id=aad7b5d260224bf496f850a91a555d72)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:24.214048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9e609-a334-4bca-ae86-84f7b2731cb9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:24.214912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bbfb7-c272-47ec-ba93-4b1fd1bb66cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:24.215758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bbfb7-c272-47ec-ba93-4b1fd1bb66cc None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:24.216102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bbfb7-c272-47ec-ba93-4b1fd1bb66cc None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:24.216524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bbfb7-c272-47ec-ba93-4b1fd1bb66cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:24.231818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 166/330] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Sep 3 01:09:24 2022] PUT /identity/v3/system/users/d30146246f9949aaae317ab6d1795bd6/roles/aad7b5d260224bf496f850a91a555d72 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:24.235014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bbfb7-c272-47ec-ba93-4b1fd1bb66cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-9a8bbfb7-c272-47ec-ba93-4b1fd1bb66cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:24.240832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:24.241872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:24.242640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 165/331] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:24.248144 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9e609-a334-4bca-ae86-84f7b2731cb9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:24.318155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:24.370283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9e609-a334-4bca-ae86-84f7b2731cb9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:24.418072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e40f1d-62dd-4840-b232-51c539edd82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:24.419049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e40f1d-62dd-4840-b232-51c539edd82c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:24.419610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e40f1d-62dd-4840-b232-51c539edd82c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:24.420101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e40f1d-62dd-4840-b232-51c539edd82c None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:24.421129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e40f1d-62dd-4840-b232-51c539edd82c None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:24.421658 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e40f1d-62dd-4840-b232-51c539edd82c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:24.423279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e40f1d-62dd-4840-b232-51c539edd82c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:24.433338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 167/332] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:24.440050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bbfb7-c272-47ec-ba93-4b1fd1bb66cc None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:24.480630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:24.570946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bbfb7-c272-47ec-ba93-4b1fd1bb66cc None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:24.624057 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc84932-938f-45af-a3de-7007957cc44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:24.624746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc84932-938f-45af-a3de-7007957cc44d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:24.625021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc84932-938f-45af-a3de-7007957cc44d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:24.625338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc84932-938f-45af-a3de-7007957cc44d None admin] PATH_INFO: `/v3/users/d41b17d0a05c4abab6f5bc346657fad1` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:24.626462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc84932-938f-45af-a3de-7007957cc44d None admin] RBAC: Authorizing `identity:get_user(user_id=d41b17d0a05c4abab6f5bc346657fad1)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:24.628264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc84932-938f-45af-a3de-7007957cc44d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:24.629878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 166/333] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:24 2022] GET /identity/v3/users/d41b17d0a05c4abab6f5bc346657fad1 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:24.636240 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e40f1d-62dd-4840-b232-51c539edd82c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:24.762695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e40f1d-62dd-4840-b232-51c539edd82c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:24.804289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:24.807948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d73b6-87f9-4d86-bf43-6d46e2080b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:24.808583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d73b6-87f9-4d86-bf43-6d46e2080b78 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:24.808864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d73b6-87f9-4d86-bf43-6d46e2080b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:24.809141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d73b6-87f9-4d86-bf43-6d46e2080b78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:24.809879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d73b6-87f9-4d86-bf43-6d46e2080b78 None admin] RBAC: Adding query filter params (role.id=b6a39390284c4cef8e11ad0888016b38, user.id=d41b17d0a05c4abab6f5bc346657fad1, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:24.810181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d73b6-87f9-4d86-bf43-6d46e2080b78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:24.811664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d73b6-87f9-4d86-bf43-6d46e2080b78 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:24.827369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 168/334] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Sep 3 01:09:24 2022] GET /identity/v3/role_assignments?user.id=d41b17d0a05c4abab6f5bc346657fad1&scope.system=all&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:26.140697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916e6b1-a1bd-4211-ac87-a327f908a8ea None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:26.141264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916e6b1-a1bd-4211-ac87-a327f908a8ea None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:26.141264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916e6b1-a1bd-4211-ac87-a327f908a8ea None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:26.143025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 167/335] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:26.151302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7c04-e495-4163-8c5f-2c04015a3a2c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:26.151786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7c04-e495-4163-8c5f-2c04015a3a2c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:26.151857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7c04-e495-4163-8c5f-2c04015a3a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:26.171568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-188c7c04-e495-4163-8c5f-2c04015a3a2c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:26.172781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-188c7c04-e495-4163-8c5f-2c04015a3a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:26.272221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 169/336] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:26.475292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3057da-529e-491d-b412-6085e7c57713 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:26.475632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3057da-529e-491d-b412-6085e7c57713 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:26.475805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3057da-529e-491d-b412-6085e7c57713 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:26.477412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 168/337] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:26.482784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daafe1-f9fd-4f48-b2a2-66a38b434561 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:26.483069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daafe1-f9fd-4f48-b2a2-66a38b434561 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:26.483369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daafe1-f9fd-4f48-b2a2-66a38b434561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:26.508264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-05daafe1-f9fd-4f48-b2a2-66a38b434561 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:26.509478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-05daafe1-f9fd-4f48-b2a2-66a38b434561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:26.605896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 170/338] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:26.877399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3057da-529e-491d-b412-6085e7c57713 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:26.914216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b3f49-b577-45de-86c0-7ca7fbfe1d26 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:26.914536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b3f49-b577-45de-86c0-7ca7fbfe1d26 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:26.914774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b3f49-b577-45de-86c0-7ca7fbfe1d26 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:26.916388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 171/339] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:26.923351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44a21-aae1-48c2-9fbf-01d037299e3b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:26.924037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44a21-aae1-48c2-9fbf-01d037299e3b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:26.924037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44a21-aae1-48c2-9fbf-01d037299e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:26.953062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-dbf44a21-aae1-48c2-9fbf-01d037299e3b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:26.954260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dbf44a21-aae1-48c2-9fbf-01d037299e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:27.019488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:27.025078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:27.027314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3057da-529e-491d-b412-6085e7c57713 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:27.082603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 172/340] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:27.083601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf44a21-aae1-48c2-9fbf-01d037299e3b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:27.102677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da92e17-f81c-4a5f-8110-4153a83fefed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:27.103373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92e17-f81c-4a5f-8110-4153a83fefed None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:27.103657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92e17-f81c-4a5f-8110-4153a83fefed None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:27.103932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92e17-f81c-4a5f-8110-4153a83fefed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:27.124300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da92e17-f81c-4a5f-8110-4153a83fefed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-3da92e17-f81c-4a5f-8110-4153a83fefed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:27.129986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:27.130815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:27.131622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:27.135427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 169/341] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:27.137222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da92e17-f81c-4a5f-8110-4153a83fefed None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:27.188749 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf44a21-aae1-48c2-9fbf-01d037299e3b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:27.227990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284757be-48ad-47a5-b851-17e27ded9d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:27.228648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284757be-48ad-47a5-b851-17e27ded9d9d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:27.228929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284757be-48ad-47a5-b851-17e27ded9d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:27.229201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284757be-48ad-47a5-b851-17e27ded9d9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:27.241785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284757be-48ad-47a5-b851-17e27ded9d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-284757be-48ad-47a5-b851-17e27ded9d9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:27.247000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:27.247917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:27.248704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:27.253073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 173/342] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:27.254367 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284757be-48ad-47a5-b851-17e27ded9d9d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:27.291320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:27.340380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da92e17-f81c-4a5f-8110-4153a83fefed None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:27.392435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284757be-48ad-47a5-b851-17e27ded9d9d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:27.393857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9306-c29e-4790-ba62-2552bfe2eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:27.394645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9306-c29e-4790-ba62-2552bfe2eb98 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:27.395084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9306-c29e-4790-ba62-2552bfe2eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:27.395515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9306-c29e-4790-ba62-2552bfe2eb98 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:27.396323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf9306-c29e-4790-ba62-2552bfe2eb98 None admin] RBAC: Adding query filter params (name=member) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:27.396765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf9306-c29e-4790-ba62-2552bfe2eb98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:27.398300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf9306-c29e-4790-ba62-2552bfe2eb98 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:27.411823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 170/343] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:27.417564 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9306-c29e-4790-ba62-2552bfe2eb98 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:27.442573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a48fa-37c7-4bf5-8f23-c4600d781405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:27.443245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a48fa-37c7-4bf5-8f23-c4600d781405 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:27.443547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a48fa-37c7-4bf5-8f23-c4600d781405 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:27.443869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a48fa-37c7-4bf5-8f23-c4600d781405 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:27.444651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a48fa-37c7-4bf5-8f23-c4600d781405 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:27.444960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a48fa-37c7-4bf5-8f23-c4600d781405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:27.447743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a48fa-37c7-4bf5-8f23-c4600d781405 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:27.462244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 174/344] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:27.463107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:27.469644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a48fa-37c7-4bf5-8f23-c4600d781405 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:27.551025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9306-c29e-4790-ba62-2552bfe2eb98 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:27.595827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:27.603742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a48fa-37c7-4bf5-8f23-c4600d781405 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:27.616001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392b853-2655-43ed-90e5-639785d5c117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:27.616882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392b853-2655-43ed-90e5-639785d5c117 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:27.617315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392b853-2655-43ed-90e5-639785d5c117 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:27.617752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392b853-2655-43ed-90e5-639785d5c117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:27.654722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476e17-1bcc-4860-83fd-dbf86561ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:27.654722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476e17-1bcc-4860-83fd-dbf86561ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:27.656490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476e17-1bcc-4860-83fd-dbf86561ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:27.656768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476e17-1bcc-4860-83fd-dbf86561ddb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:27.720198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392b853-2655-43ed-90e5-639785d5c117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:27.722008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392b853-2655-43ed-90e5-639785d5c117 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:27.742847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476e17-1bcc-4860-83fd-dbf86561ddb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:27.744924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476e17-1bcc-4860-83fd-dbf86561ddb7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:27.750536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:27.846571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 171/345] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:09:27.847875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392b853-2655-43ed-90e5-639785d5c117 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:27.863292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:27.879405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 175/346] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:09:27.881710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4151d-8e33-469a-ad49-3684425b6959 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:27.882349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4151d-8e33-469a-ad49-3684425b6959 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:27.882763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4151d-8e33-469a-ad49-3684425b6959 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:27.884874 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 176/347] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:27.886051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd41003-5c76-4a27-b8aa-09f8a6bb2e23 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:27.886576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd41003-5c76-4a27-b8aa-09f8a6bb2e23 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:27.886849 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd41003-5c76-4a27-b8aa-09f8a6bb2e23 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:27.889732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 177/348] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:27.890461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd41003-5c76-4a27-b8aa-09f8a6bb2e23 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:27.973930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392b853-2655-43ed-90e5-639785d5c117 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:28.008519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:28.025912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f41b1-e922-4fde-828c-3329f2f0d5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:28.026889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f41b1-e922-4fde-828c-3329f2f0d5cf None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.027388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f41b1-e922-4fde-828c-3329f2f0d5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.027802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f41b1-e922-4fde-828c-3329f2f0d5cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.029541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd41003-5c76-4a27-b8aa-09f8a6bb2e23 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:28.043568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f41b1-e922-4fde-828c-3329f2f0d5cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-896f41b1-e922-4fde-828c-3329f2f0d5cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:28.048838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:28.049764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 01:09:28.050567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:28.052704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 172/349] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:28.053712 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f41b1-e922-4fde-828c-3329f2f0d5cf None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:28.073413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd5be-fe8c-4154-9717-d572d605f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:28.074319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd5be-fe8c-4154-9717-d572d605f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.074597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd5be-fe8c-4154-9717-d572d605f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.074864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd5be-fe8c-4154-9717-d572d605f9c7 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.076439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd5be-fe8c-4154-9717-d572d605f9c7 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:28.078193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd5be-fe8c-4154-9717-d572d605f9c7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:28.080366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 178/350] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:27 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:28.081907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8e1f-8b8c-4568-ba12-ccbd24d16650 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.082654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8e1f-8b8c-4568-ba12-ccbd24d16650 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.083111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8e1f-8b8c-4568-ba12-ccbd24d16650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.106738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-886e8e1f-8b8c-4568-ba12-ccbd24d16650 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:28.108470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-886e8e1f-8b8c-4568-ba12-ccbd24d16650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:28.181145 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:28.185857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f41b1-e922-4fde-828c-3329f2f0d5cf None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:28.201597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 179/351] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:28.203531 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965030c-3448-4499-9abd-a72762b680bf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.203984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965030c-3448-4499-9abd-a72762b680bf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.204417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965030c-3448-4499-9abd-a72762b680bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.225113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2965030c-3448-4499-9abd-a72762b680bf None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:28.227085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2965030c-3448-4499-9abd-a72762b680bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:28.234021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb62477-4b3e-478d-8021-c6debf823260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:28.234950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb62477-4b3e-478d-8021-c6debf823260 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.235453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb62477-4b3e-478d-8021-c6debf823260 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.235964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb62477-4b3e-478d-8021-c6debf823260 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.237694 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb62477-4b3e-478d-8021-c6debf823260 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:28.239395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb62477-4b3e-478d-8021-c6debf823260 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:28.245099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 173/352] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:28 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:28.246334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb62477-4b3e-478d-8021-c6debf823260 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:28.306601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:28.307889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 180/353] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:28.309024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965030c-3448-4499-9abd-a72762b680bf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:28.363588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb62477-4b3e-478d-8021-c6debf823260 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:28.417553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442bf74-d19f-4113-a923-31defa85017a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:28.418441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442bf74-d19f-4113-a923-31defa85017a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.418850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442bf74-d19f-4113-a923-31defa85017a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.419532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442bf74-d19f-4113-a923-31defa85017a None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.420338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442bf74-d19f-4113-a923-31defa85017a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:28.420779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442bf74-d19f-4113-a923-31defa85017a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:28.421434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965030c-3448-4499-9abd-a72762b680bf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:28.422327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442bf74-d19f-4113-a923-31defa85017a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:28.432418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 174/354] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:28.435235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb6dca-e9ef-42cf-9a69-27f8163e1472 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.435798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb6dca-e9ef-42cf-9a69-27f8163e1472 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.436282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb6dca-e9ef-42cf-9a69-27f8163e1472 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.438177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 175/355] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:28.439063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb6dca-e9ef-42cf-9a69-27f8163e1472 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:28.447770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:28.466956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280e42-dc65-41ef-94bf-7d34f5028323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:28.467691 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280e42-dc65-41ef-94bf-7d34f5028323 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.467972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280e42-dc65-41ef-94bf-7d34f5028323 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.468250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280e42-dc65-41ef-94bf-7d34f5028323 None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.476746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea280e42-dc65-41ef-94bf-7d34f5028323 None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:28.478324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea280e42-dc65-41ef-94bf-7d34f5028323 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:28.481592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 181/356] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:28 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:28.482560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280e42-dc65-41ef-94bf-7d34f5028323 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:28.569875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb6dca-e9ef-42cf-9a69-27f8163e1472 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:28.589638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:28.611182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280e42-dc65-41ef-94bf-7d34f5028323 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:28.615313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bd554-135a-43ef-aa58-0289cddbaccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:28.616036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bd554-135a-43ef-aa58-0289cddbaccd None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.616323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bd554-135a-43ef-aa58-0289cddbaccd None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.616605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bd554-135a-43ef-aa58-0289cddbaccd None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.617773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bd554-135a-43ef-aa58-0289cddbaccd None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:28.619268 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bd554-135a-43ef-aa58-0289cddbaccd None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:28.621033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 176/357] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:28 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:28.622134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe66be-8daf-440a-a385-e63af110bde9 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.622309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe66be-8daf-440a-a385-e63af110bde9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.622539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe66be-8daf-440a-a385-e63af110bde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.640918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-44fe66be-8daf-440a-a385-e63af110bde9 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:28.642127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-44fe66be-8daf-440a-a385-e63af110bde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:28.653407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e9ee-647e-4f51-bb24-0482508e83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:28.654058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e9ee-647e-4f51-bb24-0482508e83ab None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.654396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e9ee-647e-4f51-bb24-0482508e83ab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.654678 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e9ee-647e-4f51-bb24-0482508e83ab None admin] PATH_INFO: `/v3/users/d30146246f9949aaae317ab6d1795bd6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.656861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6e9ee-647e-4f51-bb24-0482508e83ab None admin] RBAC: Authorizing `identity:get_user(user_id=d30146246f9949aaae317ab6d1795bd6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:28.657316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6e9ee-647e-4f51-bb24-0482508e83ab None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:28.659119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 182/358] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:09:28 2022] GET /identity/v3/users/d30146246f9949aaae317ab6d1795bd6 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:28.660088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e9ee-647e-4f51-bb24-0482508e83ab None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:28.717772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 177/359] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:28.719056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe66be-8daf-440a-a385-e63af110bde9 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:28.723503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:28.783303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e9ee-647e-4f51-bb24-0482508e83ab None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:28.826354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77770-80d8-4d35-8ffe-4f833213bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:28.827283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77770-80d8-4d35-8ffe-4f833213bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.827847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77770-80d8-4d35-8ffe-4f833213bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.828252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77770-80d8-4d35-8ffe-4f833213bfc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.829218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b77770-80d8-4d35-8ffe-4f833213bfc8 None admin] RBAC: Adding query filter params (group.id=123d25e014b64a32a599e91ede0982ab, role.id=b6a39390284c4cef8e11ad0888016b38, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:28.829655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b77770-80d8-4d35-8ffe-4f833213bfc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:28.833775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b77770-80d8-4d35-8ffe-4f833213bfc8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:28.838012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe66be-8daf-440a-a385-e63af110bde9 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:28.839080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 183/360] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Sep 3 01:09:28 2022] GET /identity/v3/role_assignments?group.id=123d25e014b64a32a599e91ede0982ab&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:28.840143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77770-80d8-4d35-8ffe-4f833213bfc8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:28.855470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:28.885026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd79709-4cfd-419d-aa0d-84711f55bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:28.886025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd79709-4cfd-419d-aa0d-84711f55bada None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:28.886474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd79709-4cfd-419d-aa0d-84711f55bada None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:28.886964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd79709-4cfd-419d-aa0d-84711f55bada None admin] PATH_INFO: `/v3/roles/member` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:28.900523 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd79709-4cfd-419d-aa0d-84711f55bada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-fcd79709-4cfd-419d-aa0d-84711f55bada None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:28.906237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:28.907144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:28.908493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:28.909140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 178/361] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:28.909722 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd79709-4cfd-419d-aa0d-84711f55bada None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:28.977327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77770-80d8-4d35-8ffe-4f833213bfc8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:28.997368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:29.028797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece9220-d3ce-41a3-8ae5-18d120ca612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:29.028797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece9220-d3ce-41a3-8ae5-18d120ca612e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:29.028797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece9220-d3ce-41a3-8ae5-18d120ca612e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:29.029153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece9220-d3ce-41a3-8ae5-18d120ca612e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:29.030514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd79709-4cfd-419d-aa0d-84711f55bada None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:29.041248 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece9220-d3ce-41a3-8ae5-18d120ca612e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7ece9220-d3ce-41a3-8ae5-18d120ca612e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:29.046728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:29.047681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:29.048510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 184/362] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:29.049190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece9220-d3ce-41a3-8ae5-18d120ca612e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:29.075633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c100c1-f60c-44ea-970b-ca74f9698774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:29.076550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c100c1-f60c-44ea-970b-ca74f9698774 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:29.077006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c100c1-f60c-44ea-970b-ca74f9698774 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:29.077451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c100c1-f60c-44ea-970b-ca74f9698774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:29.078485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c100c1-f60c-44ea-970b-ca74f9698774 None admin] RBAC: Adding query filter params (group.id=123d25e014b64a32a599e91ede0982ab, role.id=4111136d5e114c4b9ca719aa39f4bc23, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:29.079327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c100c1-f60c-44ea-970b-ca74f9698774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:29.081468 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c100c1-f60c-44ea-970b-ca74f9698774 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:29.089190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 179/363] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Sep 3 01:09:28 2022] GET /identity/v3/role_assignments?group.id=123d25e014b64a32a599e91ede0982ab&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=4111136d5e114c4b9ca719aa39f4bc23 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:29.090203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c100c1-f60c-44ea-970b-ca74f9698774 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:29.144497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:29.174760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece9220-d3ce-41a3-8ae5-18d120ca612e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:29.223434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2512bae-04f0-4d7e-9614-dcf015c99681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:29.224175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2512bae-04f0-4d7e-9614-dcf015c99681 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:29.224414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2512bae-04f0-4d7e-9614-dcf015c99681 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:29.225699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2512bae-04f0-4d7e-9614-dcf015c99681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:29.226468 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2512bae-04f0-4d7e-9614-dcf015c99681 None admin] RBAC: Adding query filter params (role.id=aad7b5d260224bf496f850a91a555d72, user.id=d30146246f9949aaae317ab6d1795bd6, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:29.226809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2512bae-04f0-4d7e-9614-dcf015c99681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:29.228375 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2512bae-04f0-4d7e-9614-dcf015c99681 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:29.240381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c100c1-f60c-44ea-970b-ca74f9698774 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:29.242231 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 185/364] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Sep 3 01:09:29 2022] GET /identity/v3/role_assignments?user.id=d30146246f9949aaae317ab6d1795bd6&scope.system=all&role.id=aad7b5d260224bf496f850a91a555d72 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:29.243187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2512bae-04f0-4d7e-9614-dcf015c99681 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:29.286601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99a6ee-f8f4-446b-bbb3-5c7e6399fd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:29.287235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99a6ee-f8f4-446b-bbb3-5c7e6399fd7a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:29.287542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99a6ee-f8f4-446b-bbb3-5c7e6399fd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:29.287816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99a6ee-f8f4-446b-bbb3-5c7e6399fd7a None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:29.288498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99a6ee-f8f4-446b-bbb3-5c7e6399fd7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:29.288806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99a6ee-f8f4-446b-bbb3-5c7e6399fd7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:29.290208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99a6ee-f8f4-446b-bbb3-5c7e6399fd7a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:29.306262 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 180/365] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:29.307052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99a6ee-f8f4-446b-bbb3-5c7e6399fd7a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:29.311577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:29.451513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2512bae-04f0-4d7e-9614-dcf015c99681 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:29.483643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:29.491327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99a6ee-f8f4-446b-bbb3-5c7e6399fd7a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:29.535140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970b17d-1b73-4fcf-bad7-bac060d33dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:29.535883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970b17d-1b73-4fcf-bad7-bac060d33dcb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:29.536232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970b17d-1b73-4fcf-bad7-bac060d33dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:29.536524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341a7a3-69bf-44e0-a055-f010b4be4f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:29.536630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970b17d-1b73-4fcf-bad7-bac060d33dcb None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:29.537181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a7a3-69bf-44e0-a055-f010b4be4f89 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:29.537310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970b17d-1b73-4fcf-bad7-bac060d33dcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:29.537442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a7a3-69bf-44e0-a055-f010b4be4f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:29.537710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a7a3-69bf-44e0-a055-f010b4be4f89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:29.537863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970b17d-1b73-4fcf-bad7-bac060d33dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:29.539303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970b17d-1b73-4fcf-bad7-bac060d33dcb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:29.550104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 181/366] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:29.551173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970b17d-1b73-4fcf-bad7-bac060d33dcb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:29.564386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341a7a3-69bf-44e0-a055-f010b4be4f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a341a7a3-69bf-44e0-a055-f010b4be4f89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:29.569682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:29.570558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 186/367] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:09:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:29.571788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341a7a3-69bf-44e0-a055-f010b4be4f89 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:29.679947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970b17d-1b73-4fcf-bad7-bac060d33dcb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:29.714721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebfe9-e42a-4045-8998-221fa417f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:29.715375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebfe9-e42a-4045-8998-221fa417f903 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:29.715656 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebfe9-e42a-4045-8998-221fa417f903 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:29.715935 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebfe9-e42a-4045-8998-221fa417f903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:29.736835 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:29.745397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:29.746613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341a7a3-69bf-44e0-a055-f010b4be4f89 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:29.790433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ebfe9-e42a-4045-8998-221fa417f903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:29.791959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ebfe9-e42a-4045-8998-221fa417f903 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:29.800757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eb8a6-34e9-4b5a-b169-ac614d905c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:29.801709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb8a6-34e9-4b5a-b169-ac614d905c87 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:29.802529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb8a6-34e9-4b5a-b169-ac614d905c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:29.803038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb8a6-34e9-4b5a-b169-ac614d905c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:29.888842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8eb8a6-34e9-4b5a-b169-ac614d905c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:29.890719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8eb8a6-34e9-4b5a-b169-ac614d905c87 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:29.906857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 182/368] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:29.908427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebfe9-e42a-4045-8998-221fa417f903 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:29.979687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:30.014781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:30.027578 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 187/369] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:30.029002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eb8a6-34e9-4b5a-b169-ac614d905c87 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:30.032987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebfe9-e42a-4045-8998-221fa417f903 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:30.070620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e4b2-4130-4bc6-a9b2-56eb0e38b395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:30.071754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e4b2-4130-4bc6-a9b2-56eb0e38b395 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:30.072232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e4b2-4130-4bc6-a9b2-56eb0e38b395 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:30.072697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e4b2-4130-4bc6-a9b2-56eb0e38b395 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:30.073554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122e4b2-4130-4bc6-a9b2-56eb0e38b395 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:30.074051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122e4b2-4130-4bc6-a9b2-56eb0e38b395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:30.075680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122e4b2-4130-4bc6-a9b2-56eb0e38b395 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:30.085424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 183/370] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:30.086618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e4b2-4130-4bc6-a9b2-56eb0e38b395 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:30.148694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eb8a6-34e9-4b5a-b169-ac614d905c87 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:30.200861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59f76a-d5a3-43bc-b2f6-c1b142368d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:30.201510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59f76a-d5a3-43bc-b2f6-c1b142368d9a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:30.201838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59f76a-d5a3-43bc-b2f6-c1b142368d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:30.202116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59f76a-d5a3-43bc-b2f6-c1b142368d9a None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:30.202276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e4b2-4130-4bc6-a9b2-56eb0e38b395 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:30.203411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59f76a-d5a3-43bc-b2f6-c1b142368d9a None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:30.204979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59f76a-d5a3-43bc-b2f6-c1b142368d9a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:30.206806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 188/371] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:30 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:30.208041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59f76a-d5a3-43bc-b2f6-c1b142368d9a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:30.225194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:30.242160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb73d39-e20c-44a2-b93f-525cb9a553cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:30.242799 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb73d39-e20c-44a2-b93f-525cb9a553cf None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:30.243079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb73d39-e20c-44a2-b93f-525cb9a553cf None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:30.243381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb73d39-e20c-44a2-b93f-525cb9a553cf None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:30.244513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb73d39-e20c-44a2-b93f-525cb9a553cf None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:30.246198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb73d39-e20c-44a2-b93f-525cb9a553cf None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:30.248221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 184/372] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:30 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:30.249156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb73d39-e20c-44a2-b93f-525cb9a553cf None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:30.281208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:30.324778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59f76a-d5a3-43bc-b2f6-c1b142368d9a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:30.361714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a5959-45da-4001-acdb-a55972eebec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:30.361942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb73d39-e20c-44a2-b93f-525cb9a553cf None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:30.362804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a5959-45da-4001-acdb-a55972eebec8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:30.363370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a5959-45da-4001-acdb-a55972eebec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:30.363993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a5959-45da-4001-acdb-a55972eebec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:30.397291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3d15-d222-4a4b-b787-443b87f1d2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:30.397940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3d15-d222-4a4b-b787-443b87f1d2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:30.398219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3d15-d222-4a4b-b787-443b87f1d2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:30.398494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3d15-d222-4a4b-b787-443b87f1d2f5 None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:30.400697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b3d15-d222-4a4b-b787-443b87f1d2f5 None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:30.402226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b3d15-d222-4a4b-b787-443b87f1d2f5 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:30.405007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 185/373] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:30 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:30.405819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3d15-d222-4a4b-b787-443b87f1d2f5 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:30.440687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a5959-45da-4001-acdb-a55972eebec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:30.442455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a5959-45da-4001-acdb-a55972eebec8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:30.468131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:30.509040 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:30.518054 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3d15-d222-4a4b-b787-443b87f1d2f5 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:30.556336 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 189/374] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:30.557657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a5959-45da-4001-acdb-a55972eebec8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:30.557911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af031d91-231a-430e-bffb-12e9694b23c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:30.558621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031d91-231a-430e-bffb-12e9694b23c6 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:30.558970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031d91-231a-430e-bffb-12e9694b23c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:30.559338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031d91-231a-430e-bffb-12e9694b23c6 None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:30.560536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af031d91-231a-430e-bffb-12e9694b23c6 None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:30.562614 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af031d91-231a-430e-bffb-12e9694b23c6 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:30.565194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 186/375] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:30 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:30.566109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af031d91-231a-430e-bffb-12e9694b23c6 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:30.670764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af031d91-231a-430e-bffb-12e9694b23c6 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:30.676005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a5959-45da-4001-acdb-a55972eebec8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:30.695932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:30.708520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89b2c4-3267-4897-b1f1-abe81086ddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:30.709166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89b2c4-3267-4897-b1f1-abe81086ddb0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:30.709513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89b2c4-3267-4897-b1f1-abe81086ddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:30.709856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89b2c4-3267-4897-b1f1-abe81086ddb0 None admin] PATH_INFO: `/v3/projects/ec3e6016635b4d4da63f35bc10e16abb` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:30.711062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89b2c4-3267-4897-b1f1-abe81086ddb0 None admin] RBAC: Authorizing `identity:get_project(project_id=ec3e6016635b4d4da63f35bc10e16abb)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:30.712665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89b2c4-3267-4897-b1f1-abe81086ddb0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:30.714669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 187/376] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:30 2022] GET /identity/v3/projects/ec3e6016635b4d4da63f35bc10e16abb => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:30.715653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89b2c4-3267-4897-b1f1-abe81086ddb0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:30.717107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860e4ff-8853-4dea-bf99-fbd76679bee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:30.717885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e4ff-8853-4dea-bf99-fbd76679bee7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:30.718410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e4ff-8853-4dea-bf99-fbd76679bee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:30.718842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e4ff-8853-4dea-bf99-fbd76679bee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:30.719845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860e4ff-8853-4dea-bf99-fbd76679bee7 None admin] RBAC: Adding query filter params (group.id=123d25e014b64a32a599e91ede0982ab, role.id=b6a39390284c4cef8e11ad0888016b38, scope.project.id=77d2af586e494e72ba2b582af008f3a3) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:30.720364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860e4ff-8853-4dea-bf99-fbd76679bee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:30.721992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860e4ff-8853-4dea-bf99-fbd76679bee7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:30.728856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 190/377] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Sep 3 01:09:30 2022] GET /identity/v3/role_assignments?group.id=123d25e014b64a32a599e91ede0982ab&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:30.729982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860e4ff-8853-4dea-bf99-fbd76679bee7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:30.762833 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:30.828478 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89b2c4-3267-4897-b1f1-abe81086ddb0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:30.857254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860e4ff-8853-4dea-bf99-fbd76679bee7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:30.867773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4071-23e5-4770-b566-b6fd1db614b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:30.868389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4071-23e5-4770-b566-b6fd1db614b9 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:30.868670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4071-23e5-4770-b566-b6fd1db614b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:30.868944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4071-23e5-4770-b566-b6fd1db614b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:30.869672 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f4071-23e5-4770-b566-b6fd1db614b9 None admin] RBAC: Adding query filter params (group.id=123d25e014b64a32a599e91ede0982ab, role.id=4111136d5e114c4b9ca719aa39f4bc23, scope.project.id=77d2af586e494e72ba2b582af008f3a3) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:30.869981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f4071-23e5-4770-b566-b6fd1db614b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:30.871487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f4071-23e5-4770-b566-b6fd1db614b9 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:30.878585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 188/378] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Sep 3 01:09:30 2022] GET /identity/v3/role_assignments?group.id=123d25e014b64a32a599e91ede0982ab&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=4111136d5e114c4b9ca719aa39f4bc23 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:30.903531 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b411935-b489-4bbb-8653-729b849847a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:30.904488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b411935-b489-4bbb-8653-729b849847a7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:30.904914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b411935-b489-4bbb-8653-729b849847a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:30.905330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b411935-b489-4bbb-8653-729b849847a7 None admin] PATH_INFO: `/v3/groups/077a9b67d423461dbe0bb867ac09a8fd` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:30.912502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b411935-b489-4bbb-8653-729b849847a7 None admin] RBAC: Authorizing `identity:get_group(group_id=077a9b67d423461dbe0bb867ac09a8fd)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:30.914346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b411935-b489-4bbb-8653-729b849847a7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:30.916796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 191/379] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:30 2022] GET /identity/v3/groups/077a9b67d423461dbe0bb867ac09a8fd => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:30.922656 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4071-23e5-4770-b566-b6fd1db614b9 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:31.010989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:31.069443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4071-23e5-4770-b566-b6fd1db614b9 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:31.105946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10b395-3ecf-4c75-949b-86f52214bf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:31.106922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b395-3ecf-4c75-949b-86f52214bf51 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:31.107199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b395-3ecf-4c75-949b-86f52214bf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:31.107508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b395-3ecf-4c75-949b-86f52214bf51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:31.108244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10b395-3ecf-4c75-949b-86f52214bf51 None admin] RBAC: Adding query filter params (group.id=077a9b67d423461dbe0bb867ac09a8fd, role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=ec3e6016635b4d4da63f35bc10e16abb) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:31.108551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10b395-3ecf-4c75-949b-86f52214bf51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:31.110017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10b395-3ecf-4c75-949b-86f52214bf51 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:31.116641 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 189/380] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Sep 3 01:09:30 2022] GET /identity/v3/role_assignments?group.id=077a9b67d423461dbe0bb867ac09a8fd&scope.project.id=ec3e6016635b4d4da63f35bc10e16abb&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:31.165599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd006e-f127-4db9-999f-5adea9d844bf None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:31.165945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd006e-f127-4db9-999f-5adea9d844bf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:31.166138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd006e-f127-4db9-999f-5adea9d844bf None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:31.167911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 192/381] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:31.178615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ff32-3259-4ff7-8893-9357960d1c41 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:31.179207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ff32-3259-4ff7-8893-9357960d1c41 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:31.179723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ff32-3259-4ff7-8893-9357960d1c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:31.203690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0a86ff32-3259-4ff7-8893-9357960d1c41 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:31.205532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0a86ff32-3259-4ff7-8893-9357960d1c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:31.309734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 190/382] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:31.602298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd006e-f127-4db9-999f-5adea9d844bf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:31.656472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb0a97-758c-4cf2-8562-e7639d0d0328 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:31.657416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb0a97-758c-4cf2-8562-e7639d0d0328 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:31.658291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb0a97-758c-4cf2-8562-e7639d0d0328 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:31.660138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 191/383] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:09:31.666742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba724c0b-3080-4d52-891a-d51ec75b9086 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:31.667331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba724c0b-3080-4d52-891a-d51ec75b9086 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:31.667821 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba724c0b-3080-4d52-891a-d51ec75b9086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:31.700532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ba724c0b-3080-4d52-891a-d51ec75b9086 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:31.702026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ba724c0b-3080-4d52-891a-d51ec75b9086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:31.707991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:31.718534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd006e-f127-4db9-999f-5adea9d844bf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:31.755095 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf243-ce6b-478a-8330-b3adff08e8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:31.755776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf243-ce6b-478a-8330-b3adff08e8dc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:31.756055 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf243-ce6b-478a-8330-b3adff08e8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:31.756324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf243-ce6b-478a-8330-b3adff08e8dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:31.768156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bf243-ce6b-478a-8330-b3adff08e8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5f4bf243-ce6b-478a-8330-b3adff08e8dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:31.773264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:31.774112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:31.774897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 193/384] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:31.781118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf243-ce6b-478a-8330-b3adff08e8dc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:31.820397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:31.865618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 192/385] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:31.888338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf243-ce6b-478a-8330-b3adff08e8dc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:31.923687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04d5f8-fa22-4b82-bced-3c7178b303f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:31.924361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04d5f8-fa22-4b82-bced-3c7178b303f1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:31.924651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04d5f8-fa22-4b82-bced-3c7178b303f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:31.924927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04d5f8-fa22-4b82-bced-3c7178b303f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:31.925600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04d5f8-fa22-4b82-bced-3c7178b303f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:31.925902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04d5f8-fa22-4b82-bced-3c7178b303f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:31.927289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04d5f8-fa22-4b82-bced-3c7178b303f1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:31.936131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 194/386] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:31.942176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba724c0b-3080-4d52-891a-d51ec75b9086 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:32.064418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba724c0b-3080-4d52-891a-d51ec75b9086 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:32.100508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c3297-fbd7-4519-a186-ec5655f64233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:32.101449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c3297-fbd7-4519-a186-ec5655f64233 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:32.101939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c3297-fbd7-4519-a186-ec5655f64233 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:32.102408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c3297-fbd7-4519-a186-ec5655f64233 None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:32.103713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c3297-fbd7-4519-a186-ec5655f64233 None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:32.105329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c3297-fbd7-4519-a186-ec5655f64233 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:32.107804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 193/387] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:31 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:32.114039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04d5f8-fa22-4b82-bced-3c7178b303f1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:32.131098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:32.202833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c3297-fbd7-4519-a186-ec5655f64233 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:32.244354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04d5f8-fa22-4b82-bced-3c7178b303f1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:32.263667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:32.295550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2805-5b74-4f21-986e-563604877e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:32.296211 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2805-5b74-4f21-986e-563604877e81 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:32.296553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2805-5b74-4f21-986e-563604877e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:32.296831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2805-5b74-4f21-986e-563604877e81 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:32.304233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2805-5b74-4f21-986e-563604877e81 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:32.305718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2805-5b74-4f21-986e-563604877e81 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:32.307872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 195/388] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:32 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:32.324829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c3297-fbd7-4519-a186-ec5655f64233 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:32.332312 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2805-5b74-4f21-986e-563604877e81 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:32.362641 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf97a-1014-4f21-8c21-963b665c6de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:32.363319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf97a-1014-4f21-8c21-963b665c6de0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:32.363600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf97a-1014-4f21-8c21-963b665c6de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:32.363871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf97a-1014-4f21-8c21-963b665c6de0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:32.375483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebf97a-1014-4f21-8c21-963b665c6de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-cbebf97a-1014-4f21-8c21-963b665c6de0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:32.382325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:32.383210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:32.384099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 194/389] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:32.392402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf97a-1014-4f21-8c21-963b665c6de0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:32.451284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:32.489419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2805-5b74-4f21-986e-563604877e81 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:32.531605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf97a-1014-4f21-8c21-963b665c6de0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:32.544706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:32.560800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3f55b-4a63-4da8-835d-e0fd61efc2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:32.561477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3f55b-4a63-4da8-835d-e0fd61efc2ad None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:32.561757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3f55b-4a63-4da8-835d-e0fd61efc2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:32.562030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3f55b-4a63-4da8-835d-e0fd61efc2ad None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/groups/123d25e014b64a32a599e91ede0982ab/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:32.564689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3f55b-4a63-4da8-835d-e0fd61efc2ad None admin] RBAC: Authorizing `identity:create_grant(project_id=dd9ad6ae07d3434aac0240c2be74fd64, group_id=123d25e014b64a32a599e91ede0982ab, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:32.566296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3f55b-4a63-4da8-835d-e0fd61efc2ad None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:32.584393 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff63c9-1496-4fb9-af0d-b7d7678cc5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:32.585280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff63c9-1496-4fb9-af0d-b7d7678cc5fc None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:32.585724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff63c9-1496-4fb9-af0d-b7d7678cc5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:32.586245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff63c9-1496-4fb9-af0d-b7d7678cc5fc None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:32.587071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff63c9-1496-4fb9-af0d-b7d7678cc5fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:32.587583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff63c9-1496-4fb9-af0d-b7d7678cc5fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:32.589625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 196/390] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Sep 3 01:09:32 2022] PUT /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/groups/123d25e014b64a32a599e91ede0982ab/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:32.589766 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff63c9-1496-4fb9-af0d-b7d7678cc5fc None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:32.607472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 195/391] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:32.611065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3f55b-4a63-4da8-835d-e0fd61efc2ad None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:32.729926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3f55b-4a63-4da8-835d-e0fd61efc2ad None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:32.777104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398e0bf-26f8-4d59-928b-8444c231e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:32.777890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398e0bf-26f8-4d59-928b-8444c231e118 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:32.778272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398e0bf-26f8-4d59-928b-8444c231e118 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:32.778556 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398e0bf-26f8-4d59-928b-8444c231e118 None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:32.779769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398e0bf-26f8-4d59-928b-8444c231e118 None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:32.781306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398e0bf-26f8-4d59-928b-8444c231e118 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:32.787414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 197/392] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:32 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:32.789931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff63c9-1496-4fb9-af0d-b7d7678cc5fc None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:32.907428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff63c9-1496-4fb9-af0d-b7d7678cc5fc None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:32.943948 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248976fd-dbbf-4f13-afc1-d809ab56e08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:32.944589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248976fd-dbbf-4f13-afc1-d809ab56e08b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:32.944872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248976fd-dbbf-4f13-afc1-d809ab56e08b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:32.945144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248976fd-dbbf-4f13-afc1-d809ab56e08b None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:32.946263 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248976fd-dbbf-4f13-afc1-d809ab56e08b None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:32.947748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248976fd-dbbf-4f13-afc1-d809ab56e08b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:32.952233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 196/393] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:32 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:32.956262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398e0bf-26f8-4d59-928b-8444c231e118 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:32.969324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:33.068680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398e0bf-26f8-4d59-928b-8444c231e118 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:33.105713 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27db564-8dd1-4477-bba2-7c82a0b14105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:33.106898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db564-8dd1-4477-bba2-7c82a0b14105 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:33.107099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db564-8dd1-4477-bba2-7c82a0b14105 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:33.107328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db564-8dd1-4477-bba2-7c82a0b14105 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/groups/123d25e014b64a32a599e91ede0982ab/roles/4111136d5e114c4b9ca719aa39f4bc23` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:33.111244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db564-8dd1-4477-bba2-7c82a0b14105 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd9ad6ae07d3434aac0240c2be74fd64, group_id=123d25e014b64a32a599e91ede0982ab, role_id=4111136d5e114c4b9ca719aa39f4bc23)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:33.114013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db564-8dd1-4477-bba2-7c82a0b14105 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:33.141113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 198/394] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Sep 3 01:09:32 2022] PUT /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64/groups/123d25e014b64a32a599e91ede0982ab/roles/4111136d5e114c4b9ca719aa39f4bc23 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:33.421054 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea533-a959-4d2b-be72-65939a7664e6 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:33.421431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea533-a959-4d2b-be72-65939a7664e6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:33.421602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea533-a959-4d2b-be72-65939a7664e6 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:33.423389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 197/395] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:33.428776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba8f33-6e65-4dfe-9d6c-29fd2663978c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:33.429062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba8f33-6e65-4dfe-9d6c-29fd2663978c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:33.429404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba8f33-6e65-4dfe-9d6c-29fd2663978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:33.450657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-00ba8f33-6e65-4dfe-9d6c-29fd2663978c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:33.451901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-00ba8f33-6e65-4dfe-9d6c-29fd2663978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:33.472836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302676-028a-4098-9c7c-d0c0ffdca56f None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:33.473460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302676-028a-4098-9c7c-d0c0ffdca56f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:33.473923 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302676-028a-4098-9c7c-d0c0ffdca56f None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:33.475711 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 198/396] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:33.481326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098db7f-9d7c-4c82-b073-1b1f687bec8d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:33.481610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098db7f-9d7c-4c82-b073-1b1f687bec8d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:33.481880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098db7f-9d7c-4c82-b073-1b1f687bec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:33.520461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-d098db7f-9d7c-4c82-b073-1b1f687bec8d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:33.521693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d098db7f-9d7c-4c82-b073-1b1f687bec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:33.531664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:33.537481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 199/397] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:33.587279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:33.641476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 199/398] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:33.691920 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e4e7-a256-46c7-9292-2d7bbef8ffda None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:33.692831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e4e7-a256-46c7-9292-2d7bbef8ffda None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:33.693300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e4e7-a256-46c7-9292-2d7bbef8ffda None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:33.695143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 200/399] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:33.700983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c67ff-de72-44a7-86bc-d9d2a064107e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:33.701263 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c67ff-de72-44a7-86bc-d9d2a064107e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:33.701533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c67ff-de72-44a7-86bc-d9d2a064107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:33.732313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-631c67ff-de72-44a7-86bc-d9d2a064107e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:33.733503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-631c67ff-de72-44a7-86bc-d9d2a064107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:33.817880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 200/400] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:33.969626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1e4e7-a256-46c7-9292-2d7bbef8ffda None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.074408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c67ff-de72-44a7-86bc-d9d2a064107e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.103796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1e4e7-a256-46c7-9292-2d7bbef8ffda None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:34.160225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224ecdb-4aac-4f18-bbce-60dcc41d123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:34.161345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224ecdb-4aac-4f18-bbce-60dcc41d123f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:34.161833 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224ecdb-4aac-4f18-bbce-60dcc41d123f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:34.162300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224ecdb-4aac-4f18-bbce-60dcc41d123f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:34.180302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224ecdb-4aac-4f18-bbce-60dcc41d123f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f224ecdb-4aac-4f18-bbce-60dcc41d123f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:34.188740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:34.189795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:34.190580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:34.191784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 201/401] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:34.202450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224ecdb-4aac-4f18-bbce-60dcc41d123f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.221086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:34.227861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c67ff-de72-44a7-86bc-d9d2a064107e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:34.278560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe5162-f940-4281-8e1e-08dadee4e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:34.279702 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe5162-f940-4281-8e1e-08dadee4e432 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:34.280320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe5162-f940-4281-8e1e-08dadee4e432 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:34.280779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe5162-f940-4281-8e1e-08dadee4e432 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:34.289946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:34.294309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe5162-f940-4281-8e1e-08dadee4e432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-05fe5162-f940-4281-8e1e-08dadee4e432 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:34.300786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:34.301642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:34.302424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:34.304716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 201/402] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:34.306874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe5162-f940-4281-8e1e-08dadee4e432 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.345929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224ecdb-4aac-4f18-bbce-60dcc41d123f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:34.392591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef07221-d314-463b-94cf-5e43c294c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:34.393601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef07221-d314-463b-94cf-5e43c294c085 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:34.394224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef07221-d314-463b-94cf-5e43c294c085 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:34.394504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef07221-d314-463b-94cf-5e43c294c085 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:34.395183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef07221-d314-463b-94cf-5e43c294c085 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:34.395528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef07221-d314-463b-94cf-5e43c294c085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:34.397172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef07221-d314-463b-94cf-5e43c294c085 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:34.408974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 202/403] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:34.409988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef07221-d314-463b-94cf-5e43c294c085 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.443276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe5162-f940-4281-8e1e-08dadee4e432 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:34.489915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148025a2-7e57-4cb2-a238-a5f4b11eb449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:34.490751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148025a2-7e57-4cb2-a238-a5f4b11eb449 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:34.491445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148025a2-7e57-4cb2-a238-a5f4b11eb449 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:34.491854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148025a2-7e57-4cb2-a238-a5f4b11eb449 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:34.506177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148025a2-7e57-4cb2-a238-a5f4b11eb449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-148025a2-7e57-4cb2-a238-a5f4b11eb449 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:34.512127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:34.512971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:34.513746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:34.514347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 202/404] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:09:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:34.515384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148025a2-7e57-4cb2-a238-a5f4b11eb449 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.541024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:34.545744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef07221-d314-463b-94cf-5e43c294c085 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:34.567292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:34.582682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cddc90-102b-4eb8-91f0-5407402bf7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:34.583358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cddc90-102b-4eb8-91f0-5407402bf7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:34.583655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cddc90-102b-4eb8-91f0-5407402bf7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:34.583926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cddc90-102b-4eb8-91f0-5407402bf7d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:34.584586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cddc90-102b-4eb8-91f0-5407402bf7d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:34.584889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cddc90-102b-4eb8-91f0-5407402bf7d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:34.586261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cddc90-102b-4eb8-91f0-5407402bf7d1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:34.595088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 203/405] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:34.596150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cddc90-102b-4eb8-91f0-5407402bf7d1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.632898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148025a2-7e57-4cb2-a238-a5f4b11eb449 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:34.670569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0d3af-f344-4aca-9c94-d29cde88bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:34.671476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0d3af-f344-4aca-9c94-d29cde88bb35 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:34.671950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0d3af-f344-4aca-9c94-d29cde88bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:34.672423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0d3af-f344-4aca-9c94-d29cde88bb35 None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:34.674014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0d3af-f344-4aca-9c94-d29cde88bb35 None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:34.675854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0d3af-f344-4aca-9c94-d29cde88bb35 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:34.677955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 203/406] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:34 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:34.678993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0d3af-f344-4aca-9c94-d29cde88bb35 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.707008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cddc90-102b-4eb8-91f0-5407402bf7d1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:34.746147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e5cd4-758f-4d17-825a-8810dc1223e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:34.746750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5cd4-758f-4d17-825a-8810dc1223e2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:34.746954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5cd4-758f-4d17-825a-8810dc1223e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:34.748109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5cd4-758f-4d17-825a-8810dc1223e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:34.748636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5cd4-758f-4d17-825a-8810dc1223e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:34.748938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5cd4-758f-4d17-825a-8810dc1223e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:34.750316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5cd4-758f-4d17-825a-8810dc1223e2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:34.759273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 204/407] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:34.763968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e5cd4-758f-4d17-825a-8810dc1223e2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.780282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:34.798774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0d3af-f344-4aca-9c94-d29cde88bb35 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:34.807072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:34.838679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5275-6926-42bc-b7d8-e1a830cbac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:34.840135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5275-6926-42bc-b7d8-e1a830cbac3c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:34.840609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5275-6926-42bc-b7d8-e1a830cbac3c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:34.841098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5275-6926-42bc-b7d8-e1a830cbac3c None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:34.842494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5275-6926-42bc-b7d8-e1a830cbac3c None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:34.844280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5275-6926-42bc-b7d8-e1a830cbac3c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:34.846617 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 204/408] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:34 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:34.847807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5275-6926-42bc-b7d8-e1a830cbac3c None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.864413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e5cd4-758f-4d17-825a-8810dc1223e2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:34.902635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55512353-2620-47c1-b0fa-31c726557a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:34.903289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55512353-2620-47c1-b0fa-31c726557a99 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:34.903579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55512353-2620-47c1-b0fa-31c726557a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:34.903903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55512353-2620-47c1-b0fa-31c726557a99 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:34.905034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55512353-2620-47c1-b0fa-31c726557a99 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:34.906525 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55512353-2620-47c1-b0fa-31c726557a99 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:34.908571 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 205/409] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:34 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:34.909357 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55512353-2620-47c1-b0fa-31c726557a99 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:34.964667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5275-6926-42bc-b7d8-e1a830cbac3c None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:35.003667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ee60-0485-44e9-8d61-b91d5fe20d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:35.004737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ee60-0485-44e9-8d61-b91d5fe20d77 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.005223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ee60-0485-44e9-8d61-b91d5fe20d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.005697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ee60-0485-44e9-8d61-b91d5fe20d77 None admin] PATH_INFO: `/v3/groups/077a9b67d423461dbe0bb867ac09a8fd` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.007097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ee60-0485-44e9-8d61-b91d5fe20d77 None admin] RBAC: Authorizing `identity:get_group(group_id=077a9b67d423461dbe0bb867ac09a8fd)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:35.008891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ee60-0485-44e9-8d61-b91d5fe20d77 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:35.010990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 205/410] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:34 2022] GET /identity/v3/groups/077a9b67d423461dbe0bb867ac09a8fd => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:35.012015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ee60-0485-44e9-8d61-b91d5fe20d77 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:35.018907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55512353-2620-47c1-b0fa-31c726557a99 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:35.031498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:35.049162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:35.060064 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d40db3-df23-4519-b939-8fea6454a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:35.060790 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d40db3-df23-4519-b939-8fea6454a874 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.061130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d40db3-df23-4519-b939-8fea6454a874 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.061475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d40db3-df23-4519-b939-8fea6454a874 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.063543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d40db3-df23-4519-b939-8fea6454a874 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:35.065424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d40db3-df23-4519-b939-8fea6454a874 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:35.067282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 206/411] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:34 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:35.073737 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effd72d-b7f1-4bb2-a04a-d04c3bff34e3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.074023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effd72d-b7f1-4bb2-a04a-d04c3bff34e3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.074294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effd72d-b7f1-4bb2-a04a-d04c3bff34e3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.075761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 207/412] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:35.079634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effd72d-b7f1-4bb2-a04a-d04c3bff34e3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:35.157045 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ee60-0485-44e9-8d61-b91d5fe20d77 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:35.192889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228d828-8770-487b-8d91-f326ee7fef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:35.193768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228d828-8770-487b-8d91-f326ee7fef57 None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.194199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228d828-8770-487b-8d91-f326ee7fef57 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.194633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228d828-8770-487b-8d91-f326ee7fef57 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3/groups/123d25e014b64a32a599e91ede0982ab/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.196730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228d828-8770-487b-8d91-f326ee7fef57 None admin] RBAC: Authorizing `identity:create_grant(project_id=77d2af586e494e72ba2b582af008f3a3, group_id=123d25e014b64a32a599e91ede0982ab, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:35.198371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228d828-8770-487b-8d91-f326ee7fef57 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:35.204172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effd72d-b7f1-4bb2-a04a-d04c3bff34e3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:35.217198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 206/413] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Sep 3 01:09:35 2022] PUT /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3/groups/123d25e014b64a32a599e91ede0982ab/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:35.218293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228d828-8770-487b-8d91-f326ee7fef57 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:35.260816 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20b84-ad40-4484-9ebc-e2c4d4509889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:35.261749 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20b84-ad40-4484-9ebc-e2c4d4509889 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.262215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20b84-ad40-4484-9ebc-e2c4d4509889 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.263481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20b84-ad40-4484-9ebc-e2c4d4509889 None admin] PATH_INFO: `/v3/projects/ec3e6016635b4d4da63f35bc10e16abb` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.266384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab20b84-ad40-4484-9ebc-e2c4d4509889 None admin] RBAC: Authorizing `identity:get_project(project_id=ec3e6016635b4d4da63f35bc10e16abb)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:35.269300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab20b84-ad40-4484-9ebc-e2c4d4509889 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:35.271091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 208/414] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:35 2022] GET /identity/v3/projects/ec3e6016635b4d4da63f35bc10e16abb => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:35.272307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9edea3-a2dd-43be-9969-bec3e20e0744 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.272589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9edea3-a2dd-43be-9969-bec3e20e0744 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.272859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9edea3-a2dd-43be-9969-bec3e20e0744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.292435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aa9edea3-a2dd-43be-9969-bec3e20e0744 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:35.293685 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aa9edea3-a2dd-43be-9969-bec3e20e0744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:35.327581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:35.349853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228d828-8770-487b-8d91-f326ee7fef57 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:35.352656 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:35.380902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 209/415] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:35.381666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9edea3-a2dd-43be-9969-bec3e20e0744 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:35.389868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb9647-a5a9-4ace-a663-74ff32e9d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:35.390536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb9647-a5a9-4ace-a663-74ff32e9d152 None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.390809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb9647-a5a9-4ace-a663-74ff32e9d152 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.391076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb9647-a5a9-4ace-a663-74ff32e9d152 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3/groups/123d25e014b64a32a599e91ede0982ab/roles/4111136d5e114c4b9ca719aa39f4bc23` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.394000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb9647-a5a9-4ace-a663-74ff32e9d152 None admin] RBAC: Authorizing `identity:create_grant(project_id=77d2af586e494e72ba2b582af008f3a3, group_id=123d25e014b64a32a599e91ede0982ab, role_id=4111136d5e114c4b9ca719aa39f4bc23)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:35.397314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb9647-a5a9-4ace-a663-74ff32e9d152 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:35.418389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 207/416] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Sep 3 01:09:35 2022] PUT /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3/groups/123d25e014b64a32a599e91ede0982ab/roles/4111136d5e114c4b9ca719aa39f4bc23 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:35.420093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429aaeb-e135-4610-af43-145f22046b93 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.420375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429aaeb-e135-4610-af43-145f22046b93 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.420687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429aaeb-e135-4610-af43-145f22046b93 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.422184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 208/417] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:35.428191 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c073-6b00-48f7-afe8-12728b9a1dfe None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.428481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c073-6b00-48f7-afe8-12728b9a1dfe None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.428765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c073-6b00-48f7-afe8-12728b9a1dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.450151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-48c1c073-6b00-48f7-afe8-12728b9a1dfe None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:35.451536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-48c1c073-6b00-48f7-afe8-12728b9a1dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:35.566413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9edea3-a2dd-43be-9969-bec3e20e0744 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:35.585340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 209/418] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:35.620281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59baad0-b065-4ad0-841a-7e7c111cfaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:35.621093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59baad0-b065-4ad0-841a-7e7c111cfaa3 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.621389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59baad0-b065-4ad0-841a-7e7c111cfaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.621662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59baad0-b065-4ad0-841a-7e7c111cfaa3 None admin] PATH_INFO: `/v3/projects/ec3e6016635b4d4da63f35bc10e16abb/groups/077a9b67d423461dbe0bb867ac09a8fd/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.623683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59baad0-b065-4ad0-841a-7e7c111cfaa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec3e6016635b4d4da63f35bc10e16abb, group_id=077a9b67d423461dbe0bb867ac09a8fd, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:35.625220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59baad0-b065-4ad0-841a-7e7c111cfaa3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:35.641765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 210/419] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Sep 3 01:09:35 2022] PUT /identity/v3/projects/ec3e6016635b4d4da63f35bc10e16abb/groups/077a9b67d423461dbe0bb867ac09a8fd/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:35.677823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c073-6b00-48f7-afe8-12728b9a1dfe None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:35.767303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:35.802741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c073-6b00-48f7-afe8-12728b9a1dfe None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:35.844432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876063d6-b6bc-4bf4-8f26-680561e54911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:35.845091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876063d6-b6bc-4bf4-8f26-680561e54911 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:35.845455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876063d6-b6bc-4bf4-8f26-680561e54911 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:35.845728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876063d6-b6bc-4bf4-8f26-680561e54911 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:35.857167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876063d6-b6bc-4bf4-8f26-680561e54911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-876063d6-b6bc-4bf4-8f26-680561e54911 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:35.863125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:35.864078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:35.864896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 210/420] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:35.870619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59baad0-b065-4ad0-841a-7e7c111cfaa3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:35.913231 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:35.918773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876063d6-b6bc-4bf4-8f26-680561e54911 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:35.982548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59baad0-b065-4ad0-841a-7e7c111cfaa3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:36.020179 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab2ce3-b658-4e9c-a843-281db7f7f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:36.020834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab2ce3-b658-4e9c-a843-281db7f7f1fc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:36.021110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab2ce3-b658-4e9c-a843-281db7f7f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:36.021563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab2ce3-b658-4e9c-a843-281db7f7f1fc None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:36.022332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab2ce3-b658-4e9c-a843-281db7f7f1fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:36.022633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab2ce3-b658-4e9c-a843-281db7f7f1fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:36.024177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab2ce3-b658-4e9c-a843-281db7f7f1fc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:36.026107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876063d6-b6bc-4bf4-8f26-680561e54911 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:36.032918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 211/421] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:36.038588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab2ce3-b658-4e9c-a843-281db7f7f1fc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:36.056231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:36.061723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd3ff-9026-4959-8f30-d49eebc9086d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:36.062494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd3ff-9026-4959-8f30-d49eebc9086d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:36.062930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd3ff-9026-4959-8f30-d49eebc9086d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:36.063308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd3ff-9026-4959-8f30-d49eebc9086d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:36.073996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cd3ff-9026-4959-8f30-d49eebc9086d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-c37cd3ff-9026-4959-8f30-d49eebc9086d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:36.079461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:36.080816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:36.081589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 211/422] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:36.087023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd3ff-9026-4959-8f30-d49eebc9086d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:36.147840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:36.151930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab2ce3-b658-4e9c-a843-281db7f7f1fc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:36.192559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3292a-ee5c-4dca-885d-abcd01e68cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:36.192559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3292a-ee5c-4dca-885d-abcd01e68cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:36.192559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3292a-ee5c-4dca-885d-abcd01e68cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:36.192559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3292a-ee5c-4dca-885d-abcd01e68cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:36.218421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd3ff-9026-4959-8f30-d49eebc9086d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:36.262114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3292a-ee5c-4dca-885d-abcd01e68cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:36.263935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3292a-ee5c-4dca-885d-abcd01e68cf3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:36.283965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46971e-16a1-4123-bbcd-38003194b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:36.284589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46971e-16a1-4123-bbcd-38003194b6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:36.284875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46971e-16a1-4123-bbcd-38003194b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:36.285149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46971e-16a1-4123-bbcd-38003194b6f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:36.285879 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46971e-16a1-4123-bbcd-38003194b6f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:36.286183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46971e-16a1-4123-bbcd-38003194b6f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:36.287589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46971e-16a1-4123-bbcd-38003194b6f3 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:36.296333 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 212/423] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:36.304258 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46971e-16a1-4123-bbcd-38003194b6f3 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:36.368661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 212/424] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:09:36.369310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:36.374738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3292a-ee5c-4dca-885d-abcd01e68cf3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:36.384774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:36.430788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46971e-16a1-4123-bbcd-38003194b6f3 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:36.468705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4668c31-f765-4fb7-846a-9e0c3d8aef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:36.469418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668c31-f765-4fb7-846a-9e0c3d8aef3a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:36.469761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668c31-f765-4fb7-846a-9e0c3d8aef3a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:36.470137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668c31-f765-4fb7-846a-9e0c3d8aef3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:36.480301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3292a-ee5c-4dca-885d-abcd01e68cf3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:36.516292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c328c7-d5d1-45c9-9358-230e976d0525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:36.517249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c328c7-d5d1-45c9-9358-230e976d0525 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:36.517423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c328c7-d5d1-45c9-9358-230e976d0525 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:36.517749 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c328c7-d5d1-45c9-9358-230e976d0525 None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:36.518862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c328c7-d5d1-45c9-9358-230e976d0525 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:36.520403 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c328c7-d5d1-45c9-9358-230e976d0525 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:36.522547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 213/425] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:36 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:36.527989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c328c7-d5d1-45c9-9358-230e976d0525 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:36.540154 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4668c31-f765-4fb7-846a-9e0c3d8aef3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:36.541636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4668c31-f765-4fb7-846a-9e0c3d8aef3a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:36.603843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:36.643957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 213/426] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:36.649692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4668c31-f765-4fb7-846a-9e0c3d8aef3a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:36.699011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:36.752818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4668c31-f765-4fb7-846a-9e0c3d8aef3a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:36.763161 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c328c7-d5d1-45c9-9358-230e976d0525 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:36.787364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b06386-b0ed-41e5-bd3e-cec73fe4eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:36.788010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06386-b0ed-41e5-bd3e-cec73fe4eeaa None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:36.788281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06386-b0ed-41e5-bd3e-cec73fe4eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:36.788572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06386-b0ed-41e5-bd3e-cec73fe4eeaa None admin] PATH_INFO: `/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:36.789739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b06386-b0ed-41e5-bd3e-cec73fe4eeaa None admin] RBAC: Authorizing `identity:get_project(project_id=dd9ad6ae07d3434aac0240c2be74fd64)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:36.791199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b06386-b0ed-41e5-bd3e-cec73fe4eeaa None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:36.793277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 214/427] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:36 2022] GET /identity/v3/projects/dd9ad6ae07d3434aac0240c2be74fd64 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:36.798979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b06386-b0ed-41e5-bd3e-cec73fe4eeaa None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:36.828819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870a4ce-641b-47eb-8800-57b11643b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:36.829456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870a4ce-641b-47eb-8800-57b11643b3eb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:36.831019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870a4ce-641b-47eb-8800-57b11643b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:36.831325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870a4ce-641b-47eb-8800-57b11643b3eb None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:36.831576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:36.833699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870a4ce-641b-47eb-8800-57b11643b3eb None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:36.837197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870a4ce-641b-47eb-8800-57b11643b3eb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:36.838817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 214/428] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:36 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:36.846700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870a4ce-641b-47eb-8800-57b11643b3eb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:36.986167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b06386-b0ed-41e5-bd3e-cec73fe4eeaa None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:37.026592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870a4ce-641b-47eb-8800-57b11643b3eb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:37.050965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98172b34-bbd9-4279-aeb0-5d41a003d7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:37.051643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98172b34-bbd9-4279-aeb0-5d41a003d7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:37.051921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98172b34-bbd9-4279-aeb0-5d41a003d7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:37.052190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98172b34-bbd9-4279-aeb0-5d41a003d7f8 None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:37.053338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98172b34-bbd9-4279-aeb0-5d41a003d7f8 None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:37.054785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98172b34-bbd9-4279-aeb0-5d41a003d7f8 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:37.058057 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 215/429] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:36 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:37.068250 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98172b34-bbd9-4279-aeb0-5d41a003d7f8 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:37.071585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a9e81-4ed3-4685-8c9c-8985bdedad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:37.072701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a9e81-4ed3-4685-8c9c-8985bdedad00 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:37.073178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a9e81-4ed3-4685-8c9c-8985bdedad00 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:37.073656 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a9e81-4ed3-4685-8c9c-8985bdedad00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:37.074576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a9e81-4ed3-4685-8c9c-8985bdedad00 None admin] RBAC: Adding query filter params (group.id=123d25e014b64a32a599e91ede0982ab, role.id=b6a39390284c4cef8e11ad0888016b38, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:37.075068 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a9e81-4ed3-4685-8c9c-8985bdedad00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:37.076906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a9e81-4ed3-4685-8c9c-8985bdedad00 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:37.080724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:37.087122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 215/430] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Sep 3 01:09:36 2022] GET /identity/v3/role_assignments?group.id=123d25e014b64a32a599e91ede0982ab&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 611 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:37.233174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:37.250757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98172b34-bbd9-4279-aeb0-5d41a003d7f8 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:37.300591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d900e96-91a2-4828-a2a5-f41273c061cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:37.301210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d900e96-91a2-4828-a2a5-f41273c061cd None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:37.301488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d900e96-91a2-4828-a2a5-f41273c061cd None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:37.301760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d900e96-91a2-4828-a2a5-f41273c061cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:37.302500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d900e96-91a2-4828-a2a5-f41273c061cd None admin] RBAC: Adding query filter params (group.id=123d25e014b64a32a599e91ede0982ab, role.id=4111136d5e114c4b9ca719aa39f4bc23, scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:37.302806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d900e96-91a2-4828-a2a5-f41273c061cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:37.304297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d900e96-91a2-4828-a2a5-f41273c061cd None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:37.314474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 216/431] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Sep 3 01:09:37 2022] GET /identity/v3/role_assignments?group.id=123d25e014b64a32a599e91ede0982ab&scope.project.id=dd9ad6ae07d3434aac0240c2be74fd64&role.id=4111136d5e114c4b9ca719aa39f4bc23 => generated 611 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:37.587585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe3c75-0e1a-4365-933c-a5735f89301d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:37.587966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe3c75-0e1a-4365-933c-a5735f89301d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:37.588137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe3c75-0e1a-4365-933c-a5735f89301d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:37.589629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 216/432] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:37.595200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea00f6c-8cfe-4ca7-8910-e1d1d64eedc3 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:37.595867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea00f6c-8cfe-4ca7-8910-e1d1d64eedc3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:37.596353 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea00f6c-8cfe-4ca7-8910-e1d1d64eedc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:37.615470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-cea00f6c-8cfe-4ca7-8910-e1d1d64eedc3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:37.616859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-cea00f6c-8cfe-4ca7-8910-e1d1d64eedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:37.685549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 217/433] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:37.834472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191380-94cc-4891-8acd-da5067bee01b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:37.835037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191380-94cc-4891-8acd-da5067bee01b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:37.835564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191380-94cc-4891-8acd-da5067bee01b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:37.837027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 217/434] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:37.842568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90457-991f-429a-85a1-4da9af4994d6 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:37.842796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90457-991f-429a-85a1-4da9af4994d6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:37.843072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90457-991f-429a-85a1-4da9af4994d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:37.862805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-94c90457-991f-429a-85a1-4da9af4994d6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:37.864039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-94c90457-991f-429a-85a1-4da9af4994d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:37.937634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 218/435] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:37.964708 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191380-94cc-4891-8acd-da5067bee01b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:38.066423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191380-94cc-4891-8acd-da5067bee01b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:38.099883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76bd4-f79d-4b78-ad9a-9e9f638fd189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:38.100432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76bd4-f79d-4b78-ad9a-9e9f638fd189 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.100704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76bd4-f79d-4b78-ad9a-9e9f638fd189 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.100987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76bd4-f79d-4b78-ad9a-9e9f638fd189 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.105035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eb2d7-d0dc-4e56-b0f5-78de26eb9068 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.105491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eb2d7-d0dc-4e56-b0f5-78de26eb9068 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.105577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eb2d7-d0dc-4e56-b0f5-78de26eb9068 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.107235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 219/436] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:09:38.112406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4881-1513-49a8-8721-8305c3491d13 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.112700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4881-1513-49a8-8721-8305c3491d13 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.112974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4881-1513-49a8-8721-8305c3491d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.114914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca76bd4-f79d-4b78-ad9a-9e9f638fd189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-dca76bd4-f79d-4b78-ad9a-9e9f638fd189 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:38.120146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:38.121140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:38.122143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 218/437] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:38.126886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76bd4-f79d-4b78-ad9a-9e9f638fd189 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:38.134127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-32db4881-1513-49a8-8721-8305c3491d13 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:38.135373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-32db4881-1513-49a8-8721-8305c3491d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:38.145384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:38.189695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:38.216237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 220/438] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:38.217084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4881-1513-49a8-8721-8305c3491d13 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:38.238122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76bd4-f79d-4b78-ad9a-9e9f638fd189 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:38.272430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcfbc6-6592-4b71-8afd-018e6b74815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:38.273434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcfbc6-6592-4b71-8afd-018e6b74815e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.273923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcfbc6-6592-4b71-8afd-018e6b74815e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.274378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcfbc6-6592-4b71-8afd-018e6b74815e None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.275601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcfbc6-6592-4b71-8afd-018e6b74815e None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:38.275966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcfbc6-6592-4b71-8afd-018e6b74815e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:38.277325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcfbc6-6592-4b71-8afd-018e6b74815e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:38.290711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 219/439] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:09:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:38.291430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcfbc6-6592-4b71-8afd-018e6b74815e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:38.316380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4881-1513-49a8-8721-8305c3491d13 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:38.352051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7566a-dc43-4c60-9bab-e465fc988cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:38.352620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7566a-dc43-4c60-9bab-e465fc988cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.352878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7566a-dc43-4c60-9bab-e465fc988cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.353148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7566a-dc43-4c60-9bab-e465fc988cb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.363443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7566a-dc43-4c60-9bab-e465fc988cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-b7b7566a-dc43-4c60-9bab-e465fc988cb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:38.368347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:38.369374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:38.370323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 221/440] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:38.375011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7566a-dc43-4c60-9bab-e465fc988cb1 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:38.383057 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:38.396906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcfbc6-6592-4b71-8afd-018e6b74815e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:38.420435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:38.433580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e1b6e-346f-4140-b828-a4233f8f1ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:38.434185 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1b6e-346f-4140-b828-a4233f8f1ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.434485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1b6e-346f-4140-b828-a4233f8f1ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.434760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1b6e-346f-4140-b828-a4233f8f1ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.484522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7566a-dc43-4c60-9bab-e465fc988cb1 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:38.504837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e1b6e-346f-4140-b828-a4233f8f1ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:38.506327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e1b6e-346f-4140-b828-a4233f8f1ac1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:38.519116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75077f0f-50ba-4f4c-bb6e-b17a6cc3a6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:38.519759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75077f0f-50ba-4f4c-bb6e-b17a6cc3a6cb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.520033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75077f0f-50ba-4f4c-bb6e-b17a6cc3a6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.520309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75077f0f-50ba-4f4c-bb6e-b17a6cc3a6cb None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.520971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75077f0f-50ba-4f4c-bb6e-b17a6cc3a6cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:38.521294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75077f0f-50ba-4f4c-bb6e-b17a6cc3a6cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:38.522659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75077f0f-50ba-4f4c-bb6e-b17a6cc3a6cb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:38.535758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 222/441] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:38.535758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75077f0f-50ba-4f4c-bb6e-b17a6cc3a6cb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:38.595930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:38.602985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 220/442] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:09:38.603811 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e1b6e-346f-4140-b828-a4233f8f1ac1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:38.630744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:38.632395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75077f0f-50ba-4f4c-bb6e-b17a6cc3a6cb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:38.664786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc41ce0-c9e2-4d45-a29f-992c7a07ee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:38.665413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc41ce0-c9e2-4d45-a29f-992c7a07ee32 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.665687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc41ce0-c9e2-4d45-a29f-992c7a07ee32 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.665955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc41ce0-c9e2-4d45-a29f-992c7a07ee32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.675672 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc41ce0-c9e2-4d45-a29f-992c7a07ee32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-bbc41ce0-c9e2-4d45-a29f-992c7a07ee32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:38.680927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:38.681834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 223/443] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:09:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:38.682793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc41ce0-c9e2-4d45-a29f-992c7a07ee32 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:38.711767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e1b6e-346f-4140-b828-a4233f8f1ac1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:38.746222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadf1dd-b6a2-48f8-becc-a8d71de846af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:38.746824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf1dd-b6a2-48f8-becc-a8d71de846af None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.747099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf1dd-b6a2-48f8-becc-a8d71de846af None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.747403 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf1dd-b6a2-48f8-becc-a8d71de846af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.780265 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc41ce0-c9e2-4d45-a29f-992c7a07ee32 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:38.805200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:38.813705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadf1dd-b6a2-48f8-becc-a8d71de846af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:38.814773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100a08d-4690-4d64-9e58-ab6dead90e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:38.815343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadf1dd-b6a2-48f8-becc-a8d71de846af None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:38.815457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100a08d-4690-4d64-9e58-ab6dead90e54 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.815700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100a08d-4690-4d64-9e58-ab6dead90e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.815975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100a08d-4690-4d64-9e58-ab6dead90e54 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.817109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100a08d-4690-4d64-9e58-ab6dead90e54 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:38.818588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100a08d-4690-4d64-9e58-ab6dead90e54 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:38.820295 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 224/444] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:38 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:38.821037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100a08d-4690-4d64-9e58-ab6dead90e54 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:38.838583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:38.914447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 221/445] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:38.915201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadf1dd-b6a2-48f8-becc-a8d71de846af None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:38.925894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100a08d-4690-4d64-9e58-ab6dead90e54 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:38.960055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e9a6-c7b6-47b3-9811-d8298f860e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:38.960651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e9a6-c7b6-47b3-9811-d8298f860e49 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:38.960952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e9a6-c7b6-47b3-9811-d8298f860e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:38.961223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e9a6-c7b6-47b3-9811-d8298f860e49 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:38.961865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733e9a6-c7b6-47b3-9811-d8298f860e49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:38.962174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733e9a6-c7b6-47b3-9811-d8298f860e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:38.963585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733e9a6-c7b6-47b3-9811-d8298f860e49 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:38.971629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 225/446] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:38.972409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e9a6-c7b6-47b3-9811-d8298f860e49 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:39.017118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadf1dd-b6a2-48f8-becc-a8d71de846af None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:39.027594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:39.039347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:39.050883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117c8ef-0491-496b-822f-a2a3bec10405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:39.051568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117c8ef-0491-496b-822f-a2a3bec10405 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:39.051843 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117c8ef-0491-496b-822f-a2a3bec10405 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:39.052136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117c8ef-0491-496b-822f-a2a3bec10405 None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:39.053274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117c8ef-0491-496b-822f-a2a3bec10405 None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:39.054720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117c8ef-0491-496b-822f-a2a3bec10405 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:39.056349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 222/447] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:38 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:39.057107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117c8ef-0491-496b-822f-a2a3bec10405 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:39.076666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e9a6-c7b6-47b3-9811-d8298f860e49 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:39.110600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8389e05-4ed0-4cce-80d7-6f24215e6883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:39.111840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8389e05-4ed0-4cce-80d7-6f24215e6883 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:39.111840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8389e05-4ed0-4cce-80d7-6f24215e6883 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:39.112018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8389e05-4ed0-4cce-80d7-6f24215e6883 None admin] PATH_INFO: `/v3/projects/77d2af586e494e72ba2b582af008f3a3` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:39.113067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8389e05-4ed0-4cce-80d7-6f24215e6883 None admin] RBAC: Authorizing `identity:get_project(project_id=77d2af586e494e72ba2b582af008f3a3)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:39.114500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8389e05-4ed0-4cce-80d7-6f24215e6883 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:39.116129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 226/448] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:38 2022] GET /identity/v3/projects/77d2af586e494e72ba2b582af008f3a3 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:39.117593 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8389e05-4ed0-4cce-80d7-6f24215e6883 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:39.158428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117c8ef-0491-496b-822f-a2a3bec10405 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:39.192175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328273a3-9aa8-40d5-8069-649dff0dc95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:39.192779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328273a3-9aa8-40d5-8069-649dff0dc95d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:39.193038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328273a3-9aa8-40d5-8069-649dff0dc95d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:39.193584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328273a3-9aa8-40d5-8069-649dff0dc95d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:39.217283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8389e05-4ed0-4cce-80d7-6f24215e6883 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:39.242681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:39.248850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:39.254928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408021b-390a-4846-8275-b18eaf123bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:39.255666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408021b-390a-4846-8275-b18eaf123bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:39.255944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408021b-390a-4846-8275-b18eaf123bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:39.256216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408021b-390a-4846-8275-b18eaf123bd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:39.256945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408021b-390a-4846-8275-b18eaf123bd4 None admin] RBAC: Adding query filter params (group.id=123d25e014b64a32a599e91ede0982ab, role.id=b6a39390284c4cef8e11ad0888016b38, scope.project.id=77d2af586e494e72ba2b582af008f3a3) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:39.257249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408021b-390a-4846-8275-b18eaf123bd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:39.258689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408021b-390a-4846-8275-b18eaf123bd4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:39.259772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328273a3-9aa8-40d5-8069-649dff0dc95d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:39.261201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328273a3-9aa8-40d5-8069-649dff0dc95d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:39.264597 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 227/449] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Sep 3 01:09:39 2022] GET /identity/v3/role_assignments?group.id=123d25e014b64a32a599e91ede0982ab&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=b6a39390284c4cef8e11ad0888016b38 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:39.265366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408021b-390a-4846-8275-b18eaf123bd4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:39.381338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 223/450] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:39.387295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328273a3-9aa8-40d5-8069-649dff0dc95d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:39.393936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408021b-390a-4846-8275-b18eaf123bd4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:39.438036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340b85-1313-4402-bc06-2c862c46d935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:39.438543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340b85-1313-4402-bc06-2c862c46d935 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:39.438917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340b85-1313-4402-bc06-2c862c46d935 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:39.439272 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340b85-1313-4402-bc06-2c862c46d935 None admin] PATH_INFO: `/v3/groups/123d25e014b64a32a599e91ede0982ab` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:39.440456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07340b85-1313-4402-bc06-2c862c46d935 None admin] RBAC: Authorizing `identity:get_group(group_id=123d25e014b64a32a599e91ede0982ab)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:39.441912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07340b85-1313-4402-bc06-2c862c46d935 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:39.447297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 228/451] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:39 2022] GET /identity/v3/groups/123d25e014b64a32a599e91ede0982ab => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:39.449456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340b85-1313-4402-bc06-2c862c46d935 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:39.493874 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:39.507401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328273a3-9aa8-40d5-8069-649dff0dc95d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:39.517671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:39.546823 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdd99f-96ce-47f1-8fb0-0116871049ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:39.547547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdd99f-96ce-47f1-8fb0-0116871049ac None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:39.547823 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdd99f-96ce-47f1-8fb0-0116871049ac None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:39.548095 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdd99f-96ce-47f1-8fb0-0116871049ac None admin] PATH_INFO: `/v3/projects/ec3e6016635b4d4da63f35bc10e16abb` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:39.549289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdd99f-96ce-47f1-8fb0-0116871049ac None admin] RBAC: Authorizing `identity:get_project(project_id=ec3e6016635b4d4da63f35bc10e16abb)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:39.550751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdd99f-96ce-47f1-8fb0-0116871049ac None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:39.552440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 224/452] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:09:39 2022] GET /identity/v3/projects/ec3e6016635b4d4da63f35bc10e16abb => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:39.558363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdd99f-96ce-47f1-8fb0-0116871049ac None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:39.579142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340b85-1313-4402-bc06-2c862c46d935 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:39.621848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801edd41-ab38-4438-afe5-1e7d9084f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:39.622553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801edd41-ab38-4438-afe5-1e7d9084f023 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:39.622893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801edd41-ab38-4438-afe5-1e7d9084f023 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:39.623859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801edd41-ab38-4438-afe5-1e7d9084f023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:39.624622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801edd41-ab38-4438-afe5-1e7d9084f023 None admin] RBAC: Adding query filter params (group.id=123d25e014b64a32a599e91ede0982ab, role.id=4111136d5e114c4b9ca719aa39f4bc23, scope.project.id=77d2af586e494e72ba2b582af008f3a3) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:39.624926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801edd41-ab38-4438-afe5-1e7d9084f023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:39.626500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801edd41-ab38-4438-afe5-1e7d9084f023 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:39.632383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 229/453] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Sep 3 01:09:39 2022] GET /identity/v3/role_assignments?group.id=123d25e014b64a32a599e91ede0982ab&scope.project.id=77d2af586e494e72ba2b582af008f3a3&role.id=4111136d5e114c4b9ca719aa39f4bc23 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:39.670117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdd99f-96ce-47f1-8fb0-0116871049ac None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:39.707965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba8d4a-8139-4808-8692-52d04cfa0c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:39.708530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba8d4a-8139-4808-8692-52d04cfa0c1c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:39.708806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba8d4a-8139-4808-8692-52d04cfa0c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:39.709081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba8d4a-8139-4808-8692-52d04cfa0c1c None admin] PATH_INFO: `/v3/groups/077a9b67d423461dbe0bb867ac09a8fd` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:39.710305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba8d4a-8139-4808-8692-52d04cfa0c1c None admin] RBAC: Authorizing `identity:get_group(group_id=077a9b67d423461dbe0bb867ac09a8fd)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:39.711926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba8d4a-8139-4808-8692-52d04cfa0c1c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:39.713587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 225/454] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Sep 3 01:09:39 2022] GET /identity/v3/groups/077a9b67d423461dbe0bb867ac09a8fd => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:39.719790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801edd41-ab38-4438-afe5-1e7d9084f023 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:39.828875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801edd41-ab38-4438-afe5-1e7d9084f023 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:39.849909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:39.864674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0f4a9-b7bc-46a4-9b3c-5e6e6083e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:39.865282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f4a9-b7bc-46a4-9b3c-5e6e6083e222 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:39.865559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f4a9-b7bc-46a4-9b3c-5e6e6083e222 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:39.865823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f4a9-b7bc-46a4-9b3c-5e6e6083e222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:39.866536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0f4a9-b7bc-46a4-9b3c-5e6e6083e222 None admin] RBAC: Adding query filter params (group.id=077a9b67d423461dbe0bb867ac09a8fd, role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=ec3e6016635b4d4da63f35bc10e16abb) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:39.866834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0f4a9-b7bc-46a4-9b3c-5e6e6083e222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:39.868307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0f4a9-b7bc-46a4-9b3c-5e6e6083e222 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:39.874221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 230/455] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Sep 3 01:09:39 2022] GET /identity/v3/role_assignments?group.id=077a9b67d423461dbe0bb867ac09a8fd&scope.project.id=ec3e6016635b4d4da63f35bc10e16abb&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:42.199353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46a4df-616c-4069-8117-fd3ea21886bb None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:42.200310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46a4df-616c-4069-8117-fd3ea21886bb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:42.200781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46a4df-616c-4069-8117-fd3ea21886bb None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:42.202373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 226/456] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:42.217061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db74a10-ab61-46d0-b7b4-bd544f8c5419 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:42.217577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db74a10-ab61-46d0-b7b4-bd544f8c5419 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:42.217577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db74a10-ab61-46d0-b7b4-bd544f8c5419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:42.248273 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8db74a10-ab61-46d0-b7b4-bd544f8c5419 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:42.249482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8db74a10-ab61-46d0-b7b4-bd544f8c5419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:42.364595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 231/457] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:42.369604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304f2d9-63f5-4dff-a4e9-3ce507beb522 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:42.370142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304f2d9-63f5-4dff-a4e9-3ce507beb522 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:42.370623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304f2d9-63f5-4dff-a4e9-3ce507beb522 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:42.372387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 227/458] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:42.377187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254898c-494e-40cc-bf93-cd075460fae8 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:42.377468 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254898c-494e-40cc-bf93-cd075460fae8 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:42.377724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254898c-494e-40cc-bf93-cd075460fae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:42.400223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5254898c-494e-40cc-bf93-cd075460fae8 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:42.401408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5254898c-494e-40cc-bf93-cd075460fae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:42.492392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 232/459] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:42.639199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44925-d159-4a79-9966-0fb2d5ea2b7b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:42.639909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44925-d159-4a79-9966-0fb2d5ea2b7b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:42.640388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44925-d159-4a79-9966-0fb2d5ea2b7b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:42.642205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 228/460] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:42.647521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609b1d-2515-457b-a901-f6aaa0132b1b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:42.647806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609b1d-2515-457b-a901-f6aaa0132b1b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:42.648083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609b1d-2515-457b-a901-f6aaa0132b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:42.663607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f44925-d159-4a79-9966-0fb2d5ea2b7b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:42.672837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-dd609b1d-2515-457b-a901-f6aaa0132b1b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:42.674876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-dd609b1d-2515-457b-a901-f6aaa0132b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:42.712977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:42.724442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:42.758621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 233/461] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:42.820805 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f44925-d159-4a79-9966-0fb2d5ea2b7b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:42.866636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e93ca7-ea11-4bcd-b437-441e762d9645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:42.867278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e93ca7-ea11-4bcd-b437-441e762d9645 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:42.867561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e93ca7-ea11-4bcd-b437-441e762d9645 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:42.867827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e93ca7-ea11-4bcd-b437-441e762d9645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:42.878596 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e93ca7-ea11-4bcd-b437-441e762d9645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:42.880107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e93ca7-ea11-4bcd-b437-441e762d9645 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-16e93ca7-ea11-4bcd-b437-441e762d9645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:42.901302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:42.902271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:42.903783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:42.903783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:42.903783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:42.903783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 229/462] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:42.908539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609b1d-2515-457b-a901-f6aaa0132b1b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:42.910787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e93ca7-ea11-4bcd-b437-441e762d9645 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:43.029611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:43.070662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e93ca7-ea11-4bcd-b437-441e762d9645 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:43.091542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609b1d-2515-457b-a901-f6aaa0132b1b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:43.108849 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794ee14-bb6a-4e96-8399-1a9943e37295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:43.109810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ee14-bb6a-4e96-8399-1a9943e37295 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.110929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ee14-bb6a-4e96-8399-1a9943e37295 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.111676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ee14-bb6a-4e96-8399-1a9943e37295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.125990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794ee14-bb6a-4e96-8399-1a9943e37295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:43.128437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794ee14-bb6a-4e96-8399-1a9943e37295 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:43.131492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdeb65-19e7-4d0d-82c1-9c072c58d637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:43.132109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdeb65-19e7-4d0d-82c1-9c072c58d637 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.132389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdeb65-19e7-4d0d-82c1-9c072c58d637 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.132663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdeb65-19e7-4d0d-82c1-9c072c58d637 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.133309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdeb65-19e7-4d0d-82c1-9c072c58d637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:43.133608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdeb65-19e7-4d0d-82c1-9c072c58d637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:43.134979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdeb65-19e7-4d0d-82c1-9c072c58d637 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1794ee14-bb6a-4e96-8399-1a9943e37295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:43.147174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:43.148359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:43.149385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:43.149385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:43.149385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:43.149542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 234/463] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:43.149542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdeb65-19e7-4d0d-82c1-9c072c58d637 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:43.151232 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 230/464] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:43.157659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794ee14-bb6a-4e96-8399-1a9943e37295 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:43.186490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:43.257111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdeb65-19e7-4d0d-82c1-9c072c58d637 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:43.275848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794ee14-bb6a-4e96-8399-1a9943e37295 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:43.293988 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadad33-0d26-4f9c-adcb-462915a55262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:43.294545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadad33-0d26-4f9c-adcb-462915a55262 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.294819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadad33-0d26-4f9c-adcb-462915a55262 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.295089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadad33-0d26-4f9c-adcb-462915a55262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.305366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadad33-0d26-4f9c-adcb-462915a55262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:43.306822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadad33-0d26-4f9c-adcb-462915a55262 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:43.308156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:43.314969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7d8f3-26a4-4235-a7df-c940142aac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:43.316009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7d8f3-26a4-4235-a7df-c940142aac7b None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.316386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7d8f3-26a4-4235-a7df-c940142aac7b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.316786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7d8f3-26a4-4235-a7df-c940142aac7b None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.317448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7d8f3-26a4-4235-a7df-c940142aac7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:43.318933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7d8f3-26a4-4235-a7df-c940142aac7b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-cbadad33-0d26-4f9c-adcb-462915a55262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:43.323706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:43.324559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:43.325977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:43.325977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:43.325977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:43.325977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 235/465] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:43.325977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadad33-0d26-4f9c-adcb-462915a55262 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:43.355492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 231/466] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:09:43 2022] POST /identity/v3/users => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:09:43.358459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def35d6-d452-4ff6-b8ed-626c65183c5f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.358746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def35d6-d452-4ff6-b8ed-626c65183c5f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.359018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def35d6-d452-4ff6-b8ed-626c65183c5f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.361049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 232/467] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:43.361859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def35d6-d452-4ff6-b8ed-626c65183c5f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:43.448085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:43.474242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadad33-0d26-4f9c-adcb-462915a55262 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:43.493954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def35d6-d452-4ff6-b8ed-626c65183c5f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:43.515158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a6eaa-bb9e-4c06-851f-d4a3bfa23499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:43.515802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a6eaa-bb9e-4c06-851f-d4a3bfa23499 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.516084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a6eaa-bb9e-4c06-851f-d4a3bfa23499 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.516493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a6eaa-bb9e-4c06-851f-d4a3bfa23499 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.517124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a6eaa-bb9e-4c06-851f-d4a3bfa23499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:43.517432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a6eaa-bb9e-4c06-851f-d4a3bfa23499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:43.518921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a6eaa-bb9e-4c06-851f-d4a3bfa23499 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:43.530910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 236/468] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:43.533076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb07b4-0bf7-441b-95d7-1ee06f4f3ab1 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.533378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb07b4-0bf7-441b-95d7-1ee06f4f3ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.533655 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb07b4-0bf7-441b-95d7-1ee06f4f3ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.540460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efc588-47c8-4614-83d6-dfc10e3f28b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:43.541073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efc588-47c8-4614-83d6-dfc10e3f28b0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.541341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efc588-47c8-4614-83d6-dfc10e3f28b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.541609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efc588-47c8-4614-83d6-dfc10e3f28b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.542258 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efc588-47c8-4614-83d6-dfc10e3f28b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:43.542551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efc588-47c8-4614-83d6-dfc10e3f28b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:43.544409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efc588-47c8-4614-83d6-dfc10e3f28b0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:43.556029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7ecb07b4-0bf7-441b-95d7-1ee06f4f3ab1 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:43.557707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7ecb07b4-0bf7-441b-95d7-1ee06f4f3ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:43.562151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 233/469] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:43.563442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efc588-47c8-4614-83d6-dfc10e3f28b0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:43.623202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:43.636652 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 237/470] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:43.637789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb07b4-0bf7-441b-95d7-1ee06f4f3ab1 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:43.712468 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efc588-47c8-4614-83d6-dfc10e3f28b0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:43.747899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f757944-4f93-43dd-9356-173eb3552fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:43.748689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f757944-4f93-43dd-9356-173eb3552fb3 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.749020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f757944-4f93-43dd-9356-173eb3552fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.749347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f757944-4f93-43dd-9356-173eb3552fb3 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.750059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f757944-4f93-43dd-9356-173eb3552fb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:43.751742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f757944-4f93-43dd-9356-173eb3552fb3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:43.754602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:43.779400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 234/471] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:09:43 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:09:43.780725 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b7cd-13e4-46dd-ad3b-f9de0aa4a75c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.781052 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b7cd-13e4-46dd-ad3b-f9de0aa4a75c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.781323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b7cd-13e4-46dd-ad3b-f9de0aa4a75c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.786685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb07b4-0bf7-441b-95d7-1ee06f4f3ab1 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:43.787311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 235/472] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:43.788748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87de6d-b60b-44fb-ab31-1e820095d9a7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.789034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87de6d-b60b-44fb-ab31-1e820095d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.789417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87de6d-b60b-44fb-ab31-1e820095d9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.809620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4a87de6d-b60b-44fb-ab31-1e820095d9a7 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:43.810884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4a87de6d-b60b-44fb-ab31-1e820095d9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:43.858908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e600726-6748-4d91-bdc2-5bdaf2fd2fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:43.860201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e600726-6748-4d91-bdc2-5bdaf2fd2fc7 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:43.860594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e600726-6748-4d91-bdc2-5bdaf2fd2fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:43.860882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e600726-6748-4d91-bdc2-5bdaf2fd2fc7 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:43.861751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e600726-6748-4d91-bdc2-5bdaf2fd2fc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:43.863981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e600726-6748-4d91-bdc2-5bdaf2fd2fc7 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:43.913813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 238/473] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:09:43 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:09:43.922310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 236/474] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:43.945183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e600726-6748-4d91-bdc2-5bdaf2fd2fc7 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:44.071473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e600726-6748-4d91-bdc2-5bdaf2fd2fc7 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:44.109242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:44.116530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a87a91-9cf7-4aff-8f9f-6b6753ed5a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:44.117179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a87a91-9cf7-4aff-8f9f-6b6753ed5a34 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:44.117455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a87a91-9cf7-4aff-8f9f-6b6753ed5a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:44.117722 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a87a91-9cf7-4aff-8f9f-6b6753ed5a34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:44.130728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a87a91-9cf7-4aff-8f9f-6b6753ed5a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:44.132244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a87a91-9cf7-4aff-8f9f-6b6753ed5a34 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-b8a87a91-9cf7-4aff-8f9f-6b6753ed5a34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:44.147517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:44.148469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:44.149727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:44.149727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:44.149727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:44.149727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 239/475] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:44.156662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87de6d-b60b-44fb-ab31-1e820095d9a7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:44.189292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:44.241008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a87a91-9cf7-4aff-8f9f-6b6753ed5a34 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:44.267064 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87de6d-b60b-44fb-ab31-1e820095d9a7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:44.302081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af2a94-0687-439f-9ce4-87d75b946493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:44.302704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2a94-0687-439f-9ce4-87d75b946493 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:44.302961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2a94-0687-439f-9ce4-87d75b946493 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:44.303230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2a94-0687-439f-9ce4-87d75b946493 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:44.303903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2a94-0687-439f-9ce4-87d75b946493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:44.304197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2a94-0687-439f-9ce4-87d75b946493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:44.305566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2a94-0687-439f-9ce4-87d75b946493 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:44.317705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 237/476] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:44.323633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af2a94-0687-439f-9ce4-87d75b946493 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:44.368295 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a87a91-9cf7-4aff-8f9f-6b6753ed5a34 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:44.403593 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0d56d-97d1-4f39-9ba7-e269b2f642cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:44.404293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d56d-97d1-4f39-9ba7-e269b2f642cb None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:44.404631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d56d-97d1-4f39-9ba7-e269b2f642cb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:44.404963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d56d-97d1-4f39-9ba7-e269b2f642cb None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:44.405802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0d56d-97d1-4f39-9ba7-e269b2f642cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:44.407405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0d56d-97d1-4f39-9ba7-e269b2f642cb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:44.421226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.sql.core [None req-16d0d56d-97d1-4f39-9ba7-e269b2f642cb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 03 01:09:44.421226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 03 01:09:44.421226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [parameters: {'id': '11eb06e64c2b4fc68450bf6dfa93d759', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 03 01:09:44.421226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81480) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 03 01:09:44.435885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:44.439139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af2a94-0687-439f-9ce4-87d75b946493 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-16d0d56d-97d1-4f39-9ba7-e269b2f642cb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application conn.query(q) Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application result.read() Sep 03 01:09:44.446747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return ref.to_dict() Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 01:09:44.448781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application next(self.gen) Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application yield resource Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application next(self.gen) Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self.session.rollback() Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self.force_reraise() Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise self.value Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application session.commit() Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 03 01:09:44.450922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._prepare_impl() Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self.session.flush() Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._flush(objects) Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application compat.raise_( Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application flush_context.execute() Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rec.execute(self) Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 01:09:44.452981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 01:09:44.460024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application conn.query(q) Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application result.read() Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 01:09:44.461116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [parameters: {'id': '11eb06e64c2b4fc68450bf6dfa93d759', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:44.462738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 03 01:09:44.468020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:44.469673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 240/477] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Sep 3 01:09:44 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:44.469673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0d56d-97d1-4f39-9ba7-e269b2f642cb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:44.477018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924856db-376e-45de-b3df-3c04d7511c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:44.477624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924856db-376e-45de-b3df-3c04d7511c94 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:44.478269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924856db-376e-45de-b3df-3c04d7511c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:44.478594 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924856db-376e-45de-b3df-3c04d7511c94 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:44.479595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924856db-376e-45de-b3df-3c04d7511c94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:44.481859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924856db-376e-45de-b3df-3c04d7511c94 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:44.521465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:44.530812 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 238/478] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:09:44 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:09:44.581702 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0d56d-97d1-4f39-9ba7-e269b2f642cb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:44.621626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7f6d8-0ab6-4ede-9e28-89b7bfe211a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:44.622535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7f6d8-0ab6-4ede-9e28-89b7bfe211a3 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:44.622980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7f6d8-0ab6-4ede-9e28-89b7bfe211a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:44.623420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7f6d8-0ab6-4ede-9e28-89b7bfe211a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:44.636685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7f6d8-0ab6-4ede-9e28-89b7bfe211a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-ffa7f6d8-0ab6-4ede-9e28-89b7bfe211a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:44.642338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:44.644410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:44.646298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 241/479] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:09:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:44.651274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924856db-376e-45de-b3df-3c04d7511c94 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:44.763296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924856db-376e-45de-b3df-3c04d7511c94 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:44.808629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f747f72-df21-4c42-9c12-3245679f59e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:44.809246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f747f72-df21-4c42-9c12-3245679f59e7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:44.809527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f747f72-df21-4c42-9c12-3245679f59e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:44.809797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f747f72-df21-4c42-9c12-3245679f59e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:44.810470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f747f72-df21-4c42-9c12-3245679f59e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:44.810770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f747f72-df21-4c42-9c12-3245679f59e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:44.812186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f747f72-df21-4c42-9c12-3245679f59e7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:44.821107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 239/480] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:45.825710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b529f-0e87-486e-9886-5dd76b9a966c None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:45.826265 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b529f-0e87-486e-9886-5dd76b9a966c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:45.826265 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b529f-0e87-486e-9886-5dd76b9a966c None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:45.827912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 242/481] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:45.832952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d4966-e3f2-4381-8585-974459cc9728 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:45.833369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d4966-e3f2-4381-8585-974459cc9728 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:45.833565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d4966-e3f2-4381-8585-974459cc9728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:45.856553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-120d4966-e3f2-4381-8585-974459cc9728 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:45.857887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-120d4966-e3f2-4381-8585-974459cc9728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:45.861214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:45.947799 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 240/482] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:46.339452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12e187-29f4-4c38-997b-0e87a9e34241 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:46.339820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12e187-29f4-4c38-997b-0e87a9e34241 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:46.340008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12e187-29f4-4c38-997b-0e87a9e34241 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:46.341628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 243/483] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:46.344494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d4966-e3f2-4381-8585-974459cc9728 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:46.347017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a396b-70a8-4a8c-b410-18c72d2f4bae None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:46.347333 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a396b-70a8-4a8c-b410-18c72d2f4bae None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:46.347610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a396b-70a8-4a8c-b410-18c72d2f4bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:46.378744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e54a396b-70a8-4a8c-b410-18c72d2f4bae None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:46.379980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e54a396b-70a8-4a8c-b410-18c72d2f4bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:46.488477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d4966-e3f2-4381-8585-974459cc9728 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:46.537824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 244/484] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:46.539119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776e538-9c5c-47db-9f0e-fd98d20ae5a6 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:46.539532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776e538-9c5c-47db-9f0e-fd98d20ae5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:46.539806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776e538-9c5c-47db-9f0e-fd98d20ae5a6 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:46.541249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 245/485] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:46.546370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79798-518e-4fa2-b7cd-2a67a7a7d1b7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:46.546647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79798-518e-4fa2-b7cd-2a67a7a7d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:46.546922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79798-518e-4fa2-b7cd-2a67a7a7d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:46.564032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6f085-5aa4-4339-a145-acaa9bbdf434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:46.564706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6f085-5aa4-4339-a145-acaa9bbdf434 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:46.564989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6f085-5aa4-4339-a145-acaa9bbdf434 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:46.565259 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6f085-5aa4-4339-a145-acaa9bbdf434 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:46.566242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a5f79798-518e-4fa2-b7cd-2a67a7a7d1b7 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:46.567451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a5f79798-518e-4fa2-b7cd-2a67a7a7d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:46.589968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:46.600577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:46.603999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6f085-5aa4-4339-a145-acaa9bbdf434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-91a6f085-5aa4-4339-a145-acaa9bbdf434 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:46.609327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:46.610226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:46.611090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 241/486] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:46.620219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6f085-5aa4-4339-a145-acaa9bbdf434 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:46.642231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 246/487] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:46.774817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6f085-5aa4-4339-a145-acaa9bbdf434 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:46.820377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1374fac-7e4d-4bd1-bfec-b914ad948444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:46.820995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374fac-7e4d-4bd1-bfec-b914ad948444 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:46.821270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374fac-7e4d-4bd1-bfec-b914ad948444 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:46.821541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374fac-7e4d-4bd1-bfec-b914ad948444 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:46.822218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1374fac-7e4d-4bd1-bfec-b914ad948444 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:46.822515 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1374fac-7e4d-4bd1-bfec-b914ad948444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:46.823908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1374fac-7e4d-4bd1-bfec-b914ad948444 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:46.835649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 242/488] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:46.841004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f79798-518e-4fa2-b7cd-2a67a7a7d1b7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:46.922296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1374fac-7e4d-4bd1-bfec-b914ad948444 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:46.975475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f79798-518e-4fa2-b7cd-2a67a7a7d1b7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.005519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:47.010925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f161-3e00-4278-88eb-8ded13467f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.011942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f161-3e00-4278-88eb-8ded13467f4a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.011942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f161-3e00-4278-88eb-8ded13467f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.012133 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f161-3e00-4278-88eb-8ded13467f4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.022292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3f161-3e00-4278-88eb-8ded13467f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:47.023926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3f161-3e00-4278-88eb-8ded13467f4a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-65b3f161-3e00-4278-88eb-8ded13467f4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:47.038749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:47.039914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:47.041093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:47.041093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:47.041093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:47.041093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 247/489] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:47.041792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f161-3e00-4278-88eb-8ded13467f4a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.052121 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1374fac-7e4d-4bd1-bfec-b914ad948444 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.067649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:47.089041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8cd17-7bf9-4374-9d82-0fcbd4be66f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.089685 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8cd17-7bf9-4374-9d82-0fcbd4be66f0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.089965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8cd17-7bf9-4374-9d82-0fcbd4be66f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.090246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8cd17-7bf9-4374-9d82-0fcbd4be66f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.100818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8cd17-7bf9-4374-9d82-0fcbd4be66f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b0b8cd17-7bf9-4374-9d82-0fcbd4be66f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:47.106572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:47.107496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:47.108277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 243/490] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:47.108941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8cd17-7bf9-4374-9d82-0fcbd4be66f0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.150580 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f161-3e00-4278-88eb-8ded13467f4a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.189341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc38a1-4629-4617-8e0d-6860979ddfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.192650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc38a1-4629-4617-8e0d-6860979ddfec None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.192650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc38a1-4629-4617-8e0d-6860979ddfec None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.192650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc38a1-4629-4617-8e0d-6860979ddfec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.201474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc38a1-4629-4617-8e0d-6860979ddfec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-81cc38a1-4629-4617-8e0d-6860979ddfec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:47.207917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:47.208822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:47.209611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 248/491] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:47.210274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d680cd-29be-4afd-b72b-6950c48e4f5a None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.210385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d680cd-29be-4afd-b72b-6950c48e4f5a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.211288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d680cd-29be-4afd-b72b-6950c48e4f5a None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.211875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 249/492] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:47.212547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d680cd-29be-4afd-b72b-6950c48e4f5a None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.221371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8cd17-7bf9-4374-9d82-0fcbd4be66f0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.243245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:47.256222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f394d6-d908-44f9-965b-a1fb0e448ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.256824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f394d6-d908-44f9-965b-a1fb0e448ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.257097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f394d6-d908-44f9-965b-a1fb0e448ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.257368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f394d6-d908-44f9-965b-a1fb0e448ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.258032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f394d6-d908-44f9-965b-a1fb0e448ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:47.258319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f394d6-d908-44f9-965b-a1fb0e448ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:47.259726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f394d6-d908-44f9-965b-a1fb0e448ea9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:47.271073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 244/493] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:47.272250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e3fc-101e-488c-bd87-e9f19c9b9f58 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.272524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e3fc-101e-488c-bd87-e9f19c9b9f58 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.272793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e3fc-101e-488c-bd87-e9f19c9b9f58 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.273941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 245/494] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:47.274621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4e3fc-101e-488c-bd87-e9f19c9b9f58 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.296979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:47.317551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d680cd-29be-4afd-b72b-6950c48e4f5a None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.350121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0746168-efc9-4b78-96f3-f8e362ce371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.350723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746168-efc9-4b78-96f3-f8e362ce371a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.351001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746168-efc9-4b78-96f3-f8e362ce371a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.351289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746168-efc9-4b78-96f3-f8e362ce371a None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.352002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0746168-efc9-4b78-96f3-f8e362ce371a None admin] RBAC: Adding query filter params (name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:47.352293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0746168-efc9-4b78-96f3-f8e362ce371a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:47.353691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0746168-efc9-4b78-96f3-f8e362ce371a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:47.362029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 250/495] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:47.363383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33c3b0-9482-4102-8f27-7d727dab4614 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.363717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33c3b0-9482-4102-8f27-7d727dab4614 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.363974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33c3b0-9482-4102-8f27-7d727dab4614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.374943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4e3fc-101e-488c-bd87-e9f19c9b9f58 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.381862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2d33c3b0-9482-4102-8f27-7d727dab4614 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:47.383146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2d33c3b0-9482-4102-8f27-7d727dab4614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:47.409297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1435247-f8d2-4991-8660-f9638d37b96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.409901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1435247-f8d2-4991-8660-f9638d37b96f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.410166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1435247-f8d2-4991-8660-f9638d37b96f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.410434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1435247-f8d2-4991-8660-f9638d37b96f None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.411089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1435247-f8d2-4991-8660-f9638d37b96f None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:47.411410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1435247-f8d2-4991-8660-f9638d37b96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:47.412755 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1435247-f8d2-4991-8660-f9638d37b96f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:47.420797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 246/496] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:47.421557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1435247-f8d2-4991-8660-f9638d37b96f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.459840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 251/497] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:47.461487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d55f4-4797-417e-94eb-c4395ebf8f4f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.461766 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d55f4-4797-417e-94eb-c4395ebf8f4f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.462367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d55f4-4797-417e-94eb-c4395ebf8f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.472516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:47.484231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-fd5d55f4-4797-417e-94eb-c4395ebf8f4f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:47.485474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-fd5d55f4-4797-417e-94eb-c4395ebf8f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:47.524008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1435247-f8d2-4991-8660-f9638d37b96f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.561371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cfca-2d81-49cb-be59-4b5f3e9e5cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.571314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cfca-2d81-49cb-be59-4b5f3e9e5cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.571454 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 252/498] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:47.571545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cfca-2d81-49cb-be59-4b5f3e9e5cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.571545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cfca-2d81-49cb-be59-4b5f3e9e5cb3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.571692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d55f4-4797-417e-94eb-c4395ebf8f4f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.571692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:47.580134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71cfca-2d81-49cb-be59-4b5f3e9e5cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:47.581796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71cfca-2d81-49cb-be59-4b5f3e9e5cb3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ae71cfca-2d81-49cb-be59-4b5f3e9e5cb3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:09:47.595754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:47.596888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:47.598023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:47.598023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:47.598023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:09:47.598023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:09:47.598023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:09:47.598023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:09:47.598023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:09:47.598023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:09:47.598023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:09:47.598023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:47.598636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 247/499] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:47.603360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cfca-2d81-49cb-be59-4b5f3e9e5cb3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.687360 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d55f4-4797-417e-94eb-c4395ebf8f4f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.722385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81349cc3-de00-4c96-ab3a-1f30c112f24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.723169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81349cc3-de00-4c96-ab3a-1f30c112f24b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.723604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81349cc3-de00-4c96-ab3a-1f30c112f24b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.723967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81349cc3-de00-4c96-ab3a-1f30c112f24b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.735401 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81349cc3-de00-4c96-ab3a-1f30c112f24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:47.737161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81349cc3-de00-4c96-ab3a-1f30c112f24b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:47.739900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cfca-2d81-49cb-be59-4b5f3e9e5cb3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.742911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-81349cc3-de00-4c96-ab3a-1f30c112f24b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:47.752284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:47.753199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:47.754052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:47.754052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:47.754052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:47.754052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 253/500] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:47.754275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81349cc3-de00-4c96-ab3a-1f30c112f24b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.782660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8bf76-6681-4fd4-a6fe-7048dd0b139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.783451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8bf76-6681-4fd4-a6fe-7048dd0b139c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.783730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8bf76-6681-4fd4-a6fe-7048dd0b139c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.784025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8bf76-6681-4fd4-a6fe-7048dd0b139c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.794695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8bf76-6681-4fd4-a6fe-7048dd0b139c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:47.796204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8bf76-6681-4fd4-a6fe-7048dd0b139c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-65a8bf76-6681-4fd4-a6fe-7048dd0b139c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:47.810687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:47.811646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:47.812530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:47.812530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:47.812530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:47.812530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 248/501] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:47.812530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8bf76-6681-4fd4-a6fe-7048dd0b139c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.817926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:47.869051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81349cc3-de00-4c96-ab3a-1f30c112f24b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.902042 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228a435-4e8c-4948-aa46-2596c7a87d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.902633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228a435-4e8c-4948-aa46-2596c7a87d20 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.902907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228a435-4e8c-4948-aa46-2596c7a87d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.903172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228a435-4e8c-4948-aa46-2596c7a87d20 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.903920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228a435-4e8c-4948-aa46-2596c7a87d20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:47.904218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228a435-4e8c-4948-aa46-2596c7a87d20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:47.905653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228a435-4e8c-4948-aa46-2596c7a87d20 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:47.913636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8bf76-6681-4fd4-a6fe-7048dd0b139c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:47.941129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 254/502] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:47.941960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228a435-4e8c-4948-aa46-2596c7a87d20 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.946085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25f92b-61a2-4a6b-99f3-a94ce8edd866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:47.946751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25f92b-61a2-4a6b-99f3-a94ce8edd866 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:47.947082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25f92b-61a2-4a6b-99f3-a94ce8edd866 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:47.947374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25f92b-61a2-4a6b-99f3-a94ce8edd866 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:47.957991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25f92b-61a2-4a6b-99f3-a94ce8edd866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ba25f92b-61a2-4a6b-99f3-a94ce8edd866 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:47.963270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:47.964246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 249/503] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:47.965122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25f92b-61a2-4a6b-99f3-a94ce8edd866 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:47.984435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:48.043051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228a435-4e8c-4948-aa46-2596c7a87d20 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.056308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:48.063779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25f92b-61a2-4a6b-99f3-a94ce8edd866 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.077489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd8696-a287-4458-a578-efa6e6bef359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.078173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd8696-a287-4458-a578-efa6e6bef359 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.078513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd8696-a287-4458-a578-efa6e6bef359 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.078867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd8696-a287-4458-a578-efa6e6bef359 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.079761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd8696-a287-4458-a578-efa6e6bef359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:48.080057 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd8696-a287-4458-a578-efa6e6bef359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.081435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd8696-a287-4458-a578-efa6e6bef359 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.092693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 255/504] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:48.093482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd8696-a287-4458-a578-efa6e6bef359 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.099478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d08aa-b441-434b-bc61-8fcd6638eccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.100093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d08aa-b441-434b-bc61-8fcd6638eccb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.100373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d08aa-b441-434b-bc61-8fcd6638eccb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.100647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d08aa-b441-434b-bc61-8fcd6638eccb None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.101299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d08aa-b441-434b-bc61-8fcd6638eccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:48.101602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d08aa-b441-434b-bc61-8fcd6638eccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.103432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d08aa-b441-434b-bc61-8fcd6638eccb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.115907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 250/505] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:48.116696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d08aa-b441-434b-bc61-8fcd6638eccb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.192061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd8696-a287-4458-a578-efa6e6bef359 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.195405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:48.218461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d08aa-b441-434b-bc61-8fcd6638eccb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.226241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8691a4-e07b-47f1-aa5e-53e2586ff8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.226881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8691a4-e07b-47f1-aa5e-53e2586ff8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.227170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8691a4-e07b-47f1-aa5e-53e2586ff8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.227807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8691a4-e07b-47f1-aa5e-53e2586ff8d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.238907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8691a4-e07b-47f1-aa5e-53e2586ff8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.240411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8691a4-e07b-47f1-aa5e-53e2586ff8d0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.251338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb37d2c-d20c-43ff-8505-dbc1cc1a1a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.251943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37d2c-d20c-43ff-8505-dbc1cc1a1a65 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.252220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37d2c-d20c-43ff-8505-dbc1cc1a1a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.252491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37d2c-d20c-43ff-8505-dbc1cc1a1a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-ce8691a4-e07b-47f1-aa5e-53e2586ff8d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:48.254192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:48.255217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:48.256100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:48.256100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:48.256100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:48.256100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 256/506] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:48.256315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8691a4-e07b-47f1-aa5e-53e2586ff8d0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.280989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:48.320775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb37d2c-d20c-43ff-8505-dbc1cc1a1a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.322153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb37d2c-d20c-43ff-8505-dbc1cc1a1a65 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.357450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8691a4-e07b-47f1-aa5e-53e2586ff8d0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.392184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be9f91-2f98-4870-974f-7e97595dff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.393895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9f91-2f98-4870-974f-7e97595dff93 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.393895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9f91-2f98-4870-974f-7e97595dff93 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.393895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9f91-2f98-4870-974f-7e97595dff93 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.394111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be9f91-2f98-4870-974f-7e97595dff93 None admin] RBAC: Adding query filter params (name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:48.394325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be9f91-2f98-4870-974f-7e97595dff93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.396198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be9f91-2f98-4870-974f-7e97595dff93 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.397262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:48.404969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 257/507] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:48.405761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be9f91-2f98-4870-974f-7e97595dff93 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.421154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 251/508] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:48.421948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb37d2c-d20c-43ff-8505-dbc1cc1a1a65 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.495087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:48.510209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be9f91-2f98-4870-974f-7e97595dff93 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.519543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb37d2c-d20c-43ff-8505-dbc1cc1a1a65 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.542411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74134acc-b107-4d3a-b511-aa3465c47156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.543033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74134acc-b107-4d3a-b511-aa3465c47156 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.543339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74134acc-b107-4d3a-b511-aa3465c47156 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.543635 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74134acc-b107-4d3a-b511-aa3465c47156 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.551412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74134acc-b107-4d3a-b511-aa3465c47156 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.552627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e4388-67c0-4f89-8c83-907f598ca542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.552854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74134acc-b107-4d3a-b511-aa3465c47156 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.553254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e4388-67c0-4f89-8c83-907f598ca542 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.553532 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e4388-67c0-4f89-8c83-907f598ca542 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.553802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e4388-67c0-4f89-8c83-907f598ca542 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.560810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e4388-67c0-4f89-8c83-907f598ca542 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.563027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e4388-67c0-4f89-8c83-907f598ca542 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-74134acc-b107-4d3a-b511-aa3465c47156 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:09:48.565689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:48.566572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:48.567476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 258/509] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:48.568036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74134acc-b107-4d3a-b511-aa3465c47156 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5b9e4388-67c0-4f89-8c83-907f598ca542 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:09:48.580892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:48.581850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 252/510] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:48.583131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e4388-67c0-4f89-8c83-907f598ca542 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.619791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:48.671431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74134acc-b107-4d3a-b511-aa3465c47156 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.686551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e4388-67c0-4f89-8c83-907f598ca542 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.707076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52833ce6-cc31-4da0-b0ea-bbacaec892b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.707713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833ce6-cc31-4da0-b0ea-bbacaec892b0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.707999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833ce6-cc31-4da0-b0ea-bbacaec892b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.708272 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833ce6-cc31-4da0-b0ea-bbacaec892b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.708917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52833ce6-cc31-4da0-b0ea-bbacaec892b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:48.709221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52833ce6-cc31-4da0-b0ea-bbacaec892b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.710624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52833ce6-cc31-4da0-b0ea-bbacaec892b0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.720634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24995569-c8e6-4716-8573-bc421ad48022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.721262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24995569-c8e6-4716-8573-bc421ad48022 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.721540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24995569-c8e6-4716-8573-bc421ad48022 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.721814 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24995569-c8e6-4716-8573-bc421ad48022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.722196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 259/511] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:48.722975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52833ce6-cc31-4da0-b0ea-bbacaec892b0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.735432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:48.737970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24995569-c8e6-4716-8573-bc421ad48022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.739435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24995569-c8e6-4716-8573-bc421ad48022 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-24995569-c8e6-4716-8573-bc421ad48022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:48.753365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:48.754287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:48.755115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:48.755115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:48.755115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:48.755115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 253/512] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:48.755390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24995569-c8e6-4716-8573-bc421ad48022 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.833507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52833ce6-cc31-4da0-b0ea-bbacaec892b0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.839788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:48.852341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24995569-c8e6-4716-8573-bc421ad48022 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:48.867680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819e76c-d98d-4e80-ad95-fa2b9d39c042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.868311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819e76c-d98d-4e80-ad95-fa2b9d39c042 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.868584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819e76c-d98d-4e80-ad95-fa2b9d39c042 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.868837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819e76c-d98d-4e80-ad95-fa2b9d39c042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.878808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819e76c-d98d-4e80-ad95-fa2b9d39c042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.880270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819e76c-d98d-4e80-ad95-fa2b9d39c042 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.885343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb369aa-77be-4bd9-99ef-3b0685046671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:48.885946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb369aa-77be-4bd9-99ef-3b0685046671 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:48.886221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb369aa-77be-4bd9-99ef-3b0685046671 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:48.886488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb369aa-77be-4bd9-99ef-3b0685046671 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:48.887208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb369aa-77be-4bd9-99ef-3b0685046671 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:48.887539 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb369aa-77be-4bd9-99ef-3b0685046671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:48.888940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb369aa-77be-4bd9-99ef-3b0685046671 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-c819e76c-d98d-4e80-ad95-fa2b9d39c042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:48.894801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:48.895755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:48.896575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:48.896575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:48.896575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:48.896575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 260/513] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:48.896794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819e76c-d98d-4e80-ad95-fa2b9d39c042 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.926580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 254/514] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Sep 3 01:09:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:48.927466 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb369aa-77be-4bd9-99ef-3b0685046671 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:48.958557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:49.002832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819e76c-d98d-4e80-ad95-fa2b9d39c042 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:49.030110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb369aa-77be-4bd9-99ef-3b0685046671 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:49.037782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1d24f-905f-44f1-ad79-4fa1fb4a0a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:49.038389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1d24f-905f-44f1-ad79-4fa1fb4a0a63 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:49.041131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1d24f-905f-44f1-ad79-4fa1fb4a0a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:49.041131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1d24f-905f-44f1-ad79-4fa1fb4a0a63 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:49.041131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1d24f-905f-44f1-ad79-4fa1fb4a0a63 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:49.041131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1d24f-905f-44f1-ad79-4fa1fb4a0a63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:49.041596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1d24f-905f-44f1-ad79-4fa1fb4a0a63 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:49.059164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 261/515] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Sep 3 01:09:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:49.060100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1d24f-905f-44f1-ad79-4fa1fb4a0a63 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:49.067893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac756e-d0d7-440f-8adf-430db60d39ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:49.068512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac756e-d0d7-440f-8adf-430db60d39ca None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:49.068789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac756e-d0d7-440f-8adf-430db60d39ca None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:49.069060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac756e-d0d7-440f-8adf-430db60d39ca None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:49.069702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac756e-d0d7-440f-8adf-430db60d39ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:49.071139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac756e-d0d7-440f-8adf-430db60d39ca None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:49.093709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 255/516] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:09:48 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:09:49.094460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac756e-d0d7-440f-8adf-430db60d39ca None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:49.097606 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:49.194960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1d24f-905f-44f1-ad79-4fa1fb4a0a63 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:49.210943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac756e-d0d7-440f-8adf-430db60d39ca None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:49.215542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:49.237814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0847b5-f207-4cf7-ab93-7fbbb4006d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:49.237814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0847b5-f207-4cf7-ab93-7fbbb4006d65 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:49.237814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0847b5-f207-4cf7-ab93-7fbbb4006d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:49.238228 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0847b5-f207-4cf7-ab93-7fbbb4006d65 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:49.239082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0847b5-f207-4cf7-ab93-7fbbb4006d65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:49.239082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0847b5-f207-4cf7-ab93-7fbbb4006d65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:49.240461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0847b5-f207-4cf7-ab93-7fbbb4006d65 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:49.252239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 262/517] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:49.253064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0847b5-f207-4cf7-ab93-7fbbb4006d65 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:49.256541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbfb85-a35c-4795-8ec6-f2651ddc5580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:49.257255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbfb85-a35c-4795-8ec6-f2651ddc5580 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:49.257537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbfb85-a35c-4795-8ec6-f2651ddc5580 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:49.257808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbfb85-a35c-4795-8ec6-f2651ddc5580 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:49.258665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbfb85-a35c-4795-8ec6-f2651ddc5580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:49.259631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbfb85-a35c-4795-8ec6-f2651ddc5580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:49.261046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbfb85-a35c-4795-8ec6-f2651ddc5580 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:49.275055 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 256/518] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:49.275955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbfb85-a35c-4795-8ec6-f2651ddc5580 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:49.339823 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:49.363070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0847b5-f207-4cf7-ab93-7fbbb4006d65 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:49.380987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbfb85-a35c-4795-8ec6-f2651ddc5580 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:49.398713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757ec0-be09-4ca5-a11e-464835f47165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:49.399348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757ec0-be09-4ca5-a11e-464835f47165 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:49.399635 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757ec0-be09-4ca5-a11e-464835f47165 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:49.399907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757ec0-be09-4ca5-a11e-464835f47165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:49.414181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9212ab6-fd7c-40bc-a939-e5d8fdaaff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:49.414784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9212ab6-fd7c-40bc-a939-e5d8fdaaff22 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:49.415057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9212ab6-fd7c-40bc-a939-e5d8fdaaff22 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:49.415354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9212ab6-fd7c-40bc-a939-e5d8fdaaff22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:49.452242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:49.479853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61757ec0-be09-4ca5-a11e-464835f47165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:49.481820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61757ec0-be09-4ca5-a11e-464835f47165 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:49.494812 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9212ab6-fd7c-40bc-a939-e5d8fdaaff22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:49.497105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9212ab6-fd7c-40bc-a939-e5d8fdaaff22 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:49.563597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:49.594065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 263/519] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:49.594065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757ec0-be09-4ca5-a11e-464835f47165 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:49.607217 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 257/520] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:49.608330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9212ab6-fd7c-40bc-a939-e5d8fdaaff22 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:49.683921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:49.708637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757ec0-be09-4ca5-a11e-464835f47165 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:49.718858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9212ab6-fd7c-40bc-a939-e5d8fdaaff22 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:49.745772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaa957-1351-44ac-98f9-b7c354382060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:49.746525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaa957-1351-44ac-98f9-b7c354382060 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:49.746806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaa957-1351-44ac-98f9-b7c354382060 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:49.747079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaa957-1351-44ac-98f9-b7c354382060 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:49.754929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaa957-1351-44ac-98f9-b7c354382060 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:49.756421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126362af-e964-4a4d-913f-9108780c091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:49.756556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaa957-1351-44ac-98f9-b7c354382060 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:49.757050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126362af-e964-4a4d-913f-9108780c091a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:49.757321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126362af-e964-4a4d-913f-9108780c091a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:49.757586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126362af-e964-4a4d-913f-9108780c091a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:49.764754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126362af-e964-4a4d-913f-9108780c091a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:49.766279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126362af-e964-4a4d-913f-9108780c091a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-bfbaa957-1351-44ac-98f9-b7c354382060 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:09:49.768081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:49.768951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:49.769811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 264/521] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:49.770392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaa957-1351-44ac-98f9-b7c354382060 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-126362af-e964-4a4d-913f-9108780c091a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:09:49.783660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:49.784747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:49.785787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:09:49.785787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:09:49.785787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:09:49.785787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:09:49.785787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:09:49.785787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:09:49.785787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:49.785787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:49.786619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 258/522] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:49.787427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126362af-e964-4a4d-913f-9108780c091a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:49.813531 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:49.879759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaa957-1351-44ac-98f9-b7c354382060 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:49.892233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126362af-e964-4a4d-913f-9108780c091a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:49.914200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8531cb3-bdc8-4f85-8aa1-08c9cf2b59cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:49.914826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8531cb3-bdc8-4f85-8aa1-08c9cf2b59cb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:49.915103 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8531cb3-bdc8-4f85-8aa1-08c9cf2b59cb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:49.915561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8531cb3-bdc8-4f85-8aa1-08c9cf2b59cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:49.918573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:49.925540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671225-c6fb-4d8f-ad6d-53368ddb385c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:49.926174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671225-c6fb-4d8f-ad6d-53368ddb385c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:49.926448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671225-c6fb-4d8f-ad6d-53368ddb385c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:49.926725 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671225-c6fb-4d8f-ad6d-53368ddb385c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:49.928871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8531cb3-bdc8-4f85-8aa1-08c9cf2b59cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:49.930484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8531cb3-bdc8-4f85-8aa1-08c9cf2b59cb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:49.937309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25671225-c6fb-4d8f-ad6d-53368ddb385c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:49.938739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25671225-c6fb-4d8f-ad6d-53368ddb385c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-a8531cb3-bdc8-4f85-8aa1-08c9cf2b59cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:49.945211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:49.946261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:49.947075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:49.947075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:49.947075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:49.950752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 265/523] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:49.951598 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8531cb3-bdc8-4f85-8aa1-08c9cf2b59cb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-25671225-c6fb-4d8f-ad6d-53368ddb385c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:49.955818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:49.956696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:49.957520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:49.957520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:49.957520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:49.957520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 259/524] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:49.957734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671225-c6fb-4d8f-ad6d-53368ddb385c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:50.039524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:50.057246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8531cb3-bdc8-4f85-8aa1-08c9cf2b59cb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:50.068226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671225-c6fb-4d8f-ad6d-53368ddb385c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:50.093438 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d888d9-41af-4508-97e7-75a764f854da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:50.094315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d888d9-41af-4508-97e7-75a764f854da None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:50.094593 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d888d9-41af-4508-97e7-75a764f854da None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:50.095090 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d888d9-41af-4508-97e7-75a764f854da None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:50.096148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d888d9-41af-4508-97e7-75a764f854da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:50.096463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d888d9-41af-4508-97e7-75a764f854da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:50.098196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d888d9-41af-4508-97e7-75a764f854da None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:50.104810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3e545-4379-4ab5-a5b9-ab68c291d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:50.105423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3e545-4379-4ab5-a5b9-ab68c291d188 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:50.105700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3e545-4379-4ab5-a5b9-ab68c291d188 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:50.106305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3e545-4379-4ab5-a5b9-ab68c291d188 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:50.106998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3e545-4379-4ab5-a5b9-ab68c291d188 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:50.107336 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3e545-4379-4ab5-a5b9-ab68c291d188 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:50.108782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3e545-4379-4ab5-a5b9-ab68c291d188 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:50.116972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 266/525] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Sep 3 01:09:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:50.117880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d888d9-41af-4508-97e7-75a764f854da None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:50.127642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 260/526] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:09:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:50.128771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3e545-4379-4ab5-a5b9-ab68c291d188 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:50.171566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:50.233115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d888d9-41af-4508-97e7-75a764f854da None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:50.251134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3e545-4379-4ab5-a5b9-ab68c291d188 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:50.267558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb942bc-b6d8-4e04-a694-5981288bbd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:50.268166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb942bc-b6d8-4e04-a694-5981288bbd62 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:50.268437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb942bc-b6d8-4e04-a694-5981288bbd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:50.268705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb942bc-b6d8-4e04-a694-5981288bbd62 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:50.269329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb942bc-b6d8-4e04-a694-5981288bbd62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:50.269629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb942bc-b6d8-4e04-a694-5981288bbd62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:50.271002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb942bc-b6d8-4e04-a694-5981288bbd62 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:50.286616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 267/527] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:50.286616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb942bc-b6d8-4e04-a694-5981288bbd62 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:50.292053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f90a7-ce09-49bf-9a35-1121035f696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:50.292744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f90a7-ce09-49bf-9a35-1121035f696b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:50.293182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f90a7-ce09-49bf-9a35-1121035f696b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:50.293572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f90a7-ce09-49bf-9a35-1121035f696b None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:50.294314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f90a7-ce09-49bf-9a35-1121035f696b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:50.294768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f90a7-ce09-49bf-9a35-1121035f696b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:50.296431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f90a7-ce09-49bf-9a35-1121035f696b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:50.298229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:50.317030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 261/528] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:50.317944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f90a7-ce09-49bf-9a35-1121035f696b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:50.389119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb942bc-b6d8-4e04-a694-5981288bbd62 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:50.396261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:50.426543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c21e31-4dfd-48e7-bf3b-20c32863ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:50.427175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c21e31-4dfd-48e7-bf3b-20c32863ec44 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:50.427463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c21e31-4dfd-48e7-bf3b-20c32863ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:50.427738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c21e31-4dfd-48e7-bf3b-20c32863ec44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:50.433742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f90a7-ce09-49bf-9a35-1121035f696b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:50.469444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dd1cc-4483-4b7f-9564-27b8ebdd93ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:50.470072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dd1cc-4483-4b7f-9564-27b8ebdd93ed None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:50.470351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dd1cc-4483-4b7f-9564-27b8ebdd93ed None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:50.470750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dd1cc-4483-4b7f-9564-27b8ebdd93ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:50.471498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dd1cc-4483-4b7f-9564-27b8ebdd93ed None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=9c4076fd5abc4b508a0215ce22af85d6) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:50.471804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dd1cc-4483-4b7f-9564-27b8ebdd93ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:50.473253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dd1cc-4483-4b7f-9564-27b8ebdd93ed None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:50.478912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 262/529] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:50 2022] GET /identity/v3/role_assignments?user.id=9c4076fd5abc4b508a0215ce22af85d6&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:50.479879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dd1cc-4483-4b7f-9564-27b8ebdd93ed None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:50.511216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c21e31-4dfd-48e7-bf3b-20c32863ec44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:50.512919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c21e31-4dfd-48e7-bf3b-20c32863ec44 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:50.552902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:50.599870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dd1cc-4483-4b7f-9564-27b8ebdd93ed None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:50.634137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 268/530] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:09:50.635485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c21e31-4dfd-48e7-bf3b-20c32863ec44 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:50.645239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:50.647715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c73de-1878-4082-974d-c793ffbf4846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:50.648351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c73de-1878-4082-974d-c793ffbf4846 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:50.648632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c73de-1878-4082-974d-c793ffbf4846 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:50.648902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c73de-1878-4082-974d-c793ffbf4846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:50.659348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c73de-1878-4082-974d-c793ffbf4846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:50.660841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c73de-1878-4082-974d-c793ffbf4846 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-147c73de-1878-4082-974d-c793ffbf4846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:09:50.675140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:50.676314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:50.677472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:09:50.677472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:09:50.677472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:09:50.677472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:09:50.677472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:09:50.677472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:09:50.677472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:50.677472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:50.681196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 263/531] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:50.682083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c73de-1878-4082-974d-c793ffbf4846 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:50.758657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c21e31-4dfd-48e7-bf3b-20c32863ec44 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:50.792355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c73de-1878-4082-974d-c793ffbf4846 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:50.794403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074614-cf2b-4788-8fe6-8495725f2f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:50.795041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074614-cf2b-4788-8fe6-8495725f2f8f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:50.795356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074614-cf2b-4788-8fe6-8495725f2f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:50.795621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074614-cf2b-4788-8fe6-8495725f2f8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:50.803016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07074614-cf2b-4788-8fe6-8495725f2f8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:50.804516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07074614-cf2b-4788-8fe6-8495725f2f8f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:50.811628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-07074614-cf2b-4788-8fe6-8495725f2f8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:09:50.817428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:50.818506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:50.820485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:09:50.820485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:09:50.820485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:09:50.820485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:09:50.820485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:09:50.820485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:09:50.820485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:50.820485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:50.820485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 269/532] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:50.820485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074614-cf2b-4788-8fe6-8495725f2f8f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:50.833236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3c264-8a1c-4dad-b949-640298849dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:50.833924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3c264-8a1c-4dad-b949-640298849dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:50.834196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3c264-8a1c-4dad-b949-640298849dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:50.834467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3c264-8a1c-4dad-b949-640298849dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:50.847663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3c264-8a1c-4dad-b949-640298849dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:50.849358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3c264-8a1c-4dad-b949-640298849dd0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c9f3c264-8a1c-4dad-b949-640298849dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:50.865268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:50.867413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:50.869205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:50.869205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:50.869205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:50.869205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 264/533] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:50.869205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3c264-8a1c-4dad-b949-640298849dd0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:50.889305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:50.940248 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074614-cf2b-4788-8fe6-8495725f2f8f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:50.983619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3c264-8a1c-4dad-b949-640298849dd0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:51.016670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf1a0c-5aa8-4293-ac80-ac3ff266ca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:51.017732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf1a0c-5aa8-4293-ac80-ac3ff266ca59 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:51.018055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf1a0c-5aa8-4293-ac80-ac3ff266ca59 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:51.018333 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf1a0c-5aa8-4293-ac80-ac3ff266ca59 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:51.019061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf1a0c-5aa8-4293-ac80-ac3ff266ca59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:51.019396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf1a0c-5aa8-4293-ac80-ac3ff266ca59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:51.020886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf1a0c-5aa8-4293-ac80-ac3ff266ca59 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:51.025494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadde7f-cd33-46ff-a04e-bd52f6646db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:51.026461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadde7f-cd33-46ff-a04e-bd52f6646db8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:51.026922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadde7f-cd33-46ff-a04e-bd52f6646db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:51.027516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadde7f-cd33-46ff-a04e-bd52f6646db8 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:51.028633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadde7f-cd33-46ff-a04e-bd52f6646db8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:51.029214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadde7f-cd33-46ff-a04e-bd52f6646db8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:51.031208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadde7f-cd33-46ff-a04e-bd52f6646db8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:51.045337 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 265/534] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:09:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:51.046914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadde7f-cd33-46ff-a04e-bd52f6646db8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:51.061302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 270/535] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:09:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:51.062159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf1a0c-5aa8-4293-ac80-ac3ff266ca59 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:51.082555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:51.169017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadde7f-cd33-46ff-a04e-bd52f6646db8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:51.210689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf1a0c-5aa8-4293-ac80-ac3ff266ca59 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:51.217375 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b7515-ca6f-4930-b7a3-7118c0a028f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:51.217991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7515-ca6f-4930-b7a3-7118c0a028f6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:51.218261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7515-ca6f-4930-b7a3-7118c0a028f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:51.218524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7515-ca6f-4930-b7a3-7118c0a028f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:51.219167 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b7515-ca6f-4930-b7a3-7118c0a028f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:51.219504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b7515-ca6f-4930-b7a3-7118c0a028f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:51.221019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b7515-ca6f-4930-b7a3-7118c0a028f6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:51.237948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 266/536] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:51.239300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb67d9-ab14-442f-bc8b-56b87980af43 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:51.239576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb67d9-ab14-442f-bc8b-56b87980af43 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:51.239854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb67d9-ab14-442f-bc8b-56b87980af43 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:51.241211 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 267/537] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:51.245102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:51.245936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb67d9-ab14-442f-bc8b-56b87980af43 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:51.255508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b937b5-ca7d-42de-85e3-f671caa2e0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:51.256216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b937b5-ca7d-42de-85e3-f671caa2e0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:51.256553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b937b5-ca7d-42de-85e3-f671caa2e0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:51.256890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b937b5-ca7d-42de-85e3-f671caa2e0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:51.257708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b937b5-ca7d-42de-85e3-f671caa2e0e7 None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=248ccaa14fce4726826a16c4d3e6ca54) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:51.258076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b937b5-ca7d-42de-85e3-f671caa2e0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:51.259621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b937b5-ca7d-42de-85e3-f671caa2e0e7 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:51.271692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 271/538] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:51 2022] GET /identity/v3/role_assignments?user.id=248ccaa14fce4726826a16c4d3e6ca54&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:51.272684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b937b5-ca7d-42de-85e3-f671caa2e0e7 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:51.376769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:51.397639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb67d9-ab14-442f-bc8b-56b87980af43 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:51.459368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f8e35-8bae-4e48-b923-c5ae1fc1a87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:51.459919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8e35-8bae-4e48-b923-c5ae1fc1a87f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:51.460205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8e35-8bae-4e48-b923-c5ae1fc1a87f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:51.460516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8e35-8bae-4e48-b923-c5ae1fc1a87f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:51.461184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f8e35-8bae-4e48-b923-c5ae1fc1a87f None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=54131719962e4463b0b874916cb40973) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:51.462619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f8e35-8bae-4e48-b923-c5ae1fc1a87f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:51.463131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f8e35-8bae-4e48-b923-c5ae1fc1a87f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:51.470178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 268/539] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:51 2022] GET /identity/v3/role_assignments?user.id=54131719962e4463b0b874916cb40973&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:51.471790 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270269-ae4c-47dd-9944-692cd139eb3f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:51.472079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270269-ae4c-47dd-9944-692cd139eb3f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:51.472351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270269-ae4c-47dd-9944-692cd139eb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:51.486443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b937b5-ca7d-42de-85e3-f671caa2e0e7 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:51.492808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-01270269-ae4c-47dd-9944-692cd139eb3f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:51.494186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-01270269-ae4c-47dd-9944-692cd139eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:51.527415 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79fb5c-a036-48a5-b31c-57e00dba09fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:51.528379 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79fb5c-a036-48a5-b31c-57e00dba09fb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:51.528658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79fb5c-a036-48a5-b31c-57e00dba09fb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:51.528933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79fb5c-a036-48a5-b31c-57e00dba09fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:51.537260 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79fb5c-a036-48a5-b31c-57e00dba09fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:51.539469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79fb5c-a036-48a5-b31c-57e00dba09fb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-af79fb5c-a036-48a5-b31c-57e00dba09fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:09:51.554659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:51.555609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:51.556440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:09:51.556440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:09:51.556440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:09:51.556440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:09:51.556440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:09:51.556440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:09:51.556440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:51.556440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:51.556440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 272/540] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:51.569810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79fb5c-a036-48a5-b31c-57e00dba09fb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:51.649976 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 269/541] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:51.677614 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:51.743081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79fb5c-a036-48a5-b31c-57e00dba09fb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:51.789054 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bea3e1-7132-4302-8238-6813c6d4ea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:51.789668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea3e1-7132-4302-8238-6813c6d4ea8d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:51.789946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea3e1-7132-4302-8238-6813c6d4ea8d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:51.790217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea3e1-7132-4302-8238-6813c6d4ea8d None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:51.790913 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bea3e1-7132-4302-8238-6813c6d4ea8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:51.791216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bea3e1-7132-4302-8238-6813c6d4ea8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:51.792753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bea3e1-7132-4302-8238-6813c6d4ea8d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:51.810804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 273/542] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:09:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:51.817058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01270269-ae4c-47dd-9944-692cd139eb3f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:51.908372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:51.927281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01270269-ae4c-47dd-9944-692cd139eb3f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:51.967235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990df0c1-c071-4848-95f3-d57a33d4bac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:51.968237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990df0c1-c071-4848-95f3-d57a33d4bac2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:51.968701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990df0c1-c071-4848-95f3-d57a33d4bac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:51.969155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990df0c1-c071-4848-95f3-d57a33d4bac2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:51.970161 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990df0c1-c071-4848-95f3-d57a33d4bac2 None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=8bec5c8c626c40ef9906783916c49dd5) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:51.970687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990df0c1-c071-4848-95f3-d57a33d4bac2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:51.972358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990df0c1-c071-4848-95f3-d57a33d4bac2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:51.978588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 270/543] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:51 2022] GET /identity/v3/role_assignments?user.id=8bec5c8c626c40ef9906783916c49dd5&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:52.098068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bea3e1-7132-4302-8238-6813c6d4ea8d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:52.241056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bea3e1-7132-4302-8238-6813c6d4ea8d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:52.263741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:52.293049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de600972-9e0e-4e13-a679-ed780879e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:52.293694 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de600972-9e0e-4e13-a679-ed780879e541 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:52.293974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de600972-9e0e-4e13-a679-ed780879e541 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:52.294246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de600972-9e0e-4e13-a679-ed780879e541 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:52.307509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de600972-9e0e-4e13-a679-ed780879e541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-de600972-9e0e-4e13-a679-ed780879e541 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:52.312359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:52.313200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:52.314349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 274/544] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:52.320183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990df0c1-c071-4848-95f3-d57a33d4bac2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:52.439978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990df0c1-c071-4848-95f3-d57a33d4bac2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:52.482779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdca0c6-68c5-4e66-a91d-72b944caff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:52.483423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca0c6-68c5-4e66-a91d-72b944caff74 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:52.483702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca0c6-68c5-4e66-a91d-72b944caff74 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:52.483972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca0c6-68c5-4e66-a91d-72b944caff74 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:52.484647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdca0c6-68c5-4e66-a91d-72b944caff74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:52.484952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdca0c6-68c5-4e66-a91d-72b944caff74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:52.486383 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdca0c6-68c5-4e66-a91d-72b944caff74 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:52.495304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 271/545] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:52.501212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de600972-9e0e-4e13-a679-ed780879e541 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:52.589085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be0715-133e-45ab-b1e2-8e1f3c85b57b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:52.589415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be0715-133e-45ab-b1e2-8e1f3c85b57b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:52.589632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be0715-133e-45ab-b1e2-8e1f3c85b57b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:52.591465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 272/546] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:09:52.602080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc2696-21df-499c-bf1f-6ce9feda8d2d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:52.602363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc2696-21df-499c-bf1f-6ce9feda8d2d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:52.602638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc2696-21df-499c-bf1f-6ce9feda8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:52.634536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2bfc2696-21df-499c-bf1f-6ce9feda8d2d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:52.636658 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2bfc2696-21df-499c-bf1f-6ce9feda8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:52.643458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:52.645733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de600972-9e0e-4e13-a679-ed780879e541 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:52.727182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd28813-acc0-443e-b8b4-f582d199ccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:52.727757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28813-acc0-443e-b8b4-f582d199ccba None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:52.728035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28813-acc0-443e-b8b4-f582d199ccba None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:52.728304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28813-acc0-443e-b8b4-f582d199ccba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:52.739113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd28813-acc0-443e-b8b4-f582d199ccba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:52.740615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd28813-acc0-443e-b8b4-f582d199ccba None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:52.749467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 273/547] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-afd28813-acc0-443e-b8b4-f582d199ccba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:52.765727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:52.766762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:52.767605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:52.767605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:52.767605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:52.767605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 275/548] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:52.773062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc2696-21df-499c-bf1f-6ce9feda8d2d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:52.942902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc2696-21df-499c-bf1f-6ce9feda8d2d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:52.990345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b569dee-9cb6-4dc4-a4ce-87e78852ad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:52.991364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b569dee-9cb6-4dc4-a4ce-87e78852ad27 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:52.991834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b569dee-9cb6-4dc4-a4ce-87e78852ad27 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:52.992291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b569dee-9cb6-4dc4-a4ce-87e78852ad27 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:52.993142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b569dee-9cb6-4dc4-a4ce-87e78852ad27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:52.993625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b569dee-9cb6-4dc4-a4ce-87e78852ad27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:52.995183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b569dee-9cb6-4dc4-a4ce-87e78852ad27 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:53.006794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:53.010397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 274/549] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:53.016439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd28813-acc0-443e-b8b4-f582d199ccba None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:53.061885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:53.154896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b569dee-9cb6-4dc4-a4ce-87e78852ad27 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:53.164781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd28813-acc0-443e-b8b4-f582d199ccba None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:53.210394 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e19b1-9669-4313-87cc-1eff24b8185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:53.211044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e19b1-9669-4313-87cc-1eff24b8185e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:53.211343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e19b1-9669-4313-87cc-1eff24b8185e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:53.211615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e19b1-9669-4313-87cc-1eff24b8185e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:53.223091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e19b1-9669-4313-87cc-1eff24b8185e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:53.224595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e19b1-9669-4313-87cc-1eff24b8185e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-b29e19b1-9669-4313-87cc-1eff24b8185e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:09:53.243673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:53.245145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:53.246192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 276/550] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:09:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:53.252618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e19b1-9669-4313-87cc-1eff24b8185e None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:53.331476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b569dee-9cb6-4dc4-a4ce-87e78852ad27 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:53.395172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aefc8-6525-4904-a8cf-0d625484673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:53.395834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aefc8-6525-4904-a8cf-0d625484673a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:53.396149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aefc8-6525-4904-a8cf-0d625484673a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:53.396417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aefc8-6525-4904-a8cf-0d625484673a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:53.409008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:53.411983 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aefc8-6525-4904-a8cf-0d625484673a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5a0aefc8-6525-4904-a8cf-0d625484673a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:53.417727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:53.420120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:53.422256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 275/551] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:53.427788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aefc8-6525-4904-a8cf-0d625484673a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:53.450391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e19b1-9669-4313-87cc-1eff24b8185e None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:53.513321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5d34d-39b0-4594-9b38-21a957f7a4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:53.513854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5d34d-39b0-4594-9b38-21a957f7a4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:53.514132 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5d34d-39b0-4594-9b38-21a957f7a4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:53.514405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5d34d-39b0-4594-9b38-21a957f7a4e9 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:53.515149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5d34d-39b0-4594-9b38-21a957f7a4e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:53.515476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5d34d-39b0-4594-9b38-21a957f7a4e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:53.517024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5d34d-39b0-4594-9b38-21a957f7a4e9 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:53.532301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:53.552699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 277/552] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Sep 3 01:09:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:53.558966 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5d34d-39b0-4594-9b38-21a957f7a4e9 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:53.603710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aefc8-6525-4904-a8cf-0d625484673a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:53.655682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff27147-60b3-4273-832a-16ea616a0caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:53.656341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff27147-60b3-4273-832a-16ea616a0caf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:53.656615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff27147-60b3-4273-832a-16ea616a0caf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:53.656881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff27147-60b3-4273-832a-16ea616a0caf None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:53.657866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff27147-60b3-4273-832a-16ea616a0caf None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:53.658200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff27147-60b3-4273-832a-16ea616a0caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:53.659541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff27147-60b3-4273-832a-16ea616a0caf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:53.668042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 276/553] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:09:53.669214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6055f-acac-45a1-9502-5b9b449fc751 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:53.669490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6055f-acac-45a1-9502-5b9b449fc751 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:53.669757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6055f-acac-45a1-9502-5b9b449fc751 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:53.675457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 277/554] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:53.676308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6055f-acac-45a1-9502-5b9b449fc751 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:53.702838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5d34d-39b0-4594-9b38-21a957f7a4e9 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:53.744793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134cc50-9618-4e82-8de1-b5ba0ebcbbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:53.745652 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134cc50-9618-4e82-8de1-b5ba0ebcbbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:53.745927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134cc50-9618-4e82-8de1-b5ba0ebcbbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:53.746343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134cc50-9618-4e82-8de1-b5ba0ebcbbf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:53.757658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:53.789421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6055f-acac-45a1-9502-5b9b449fc751 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:53.811239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:53.818971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134cc50-9618-4e82-8de1-b5ba0ebcbbf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:53.820480 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134cc50-9618-4e82-8de1-b5ba0ebcbbf7 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:53.828418 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08216-8e51-47c5-a5c8-1dfe3aefcbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:53.829311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08216-8e51-47c5-a5c8-1dfe3aefcbee None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:53.829557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08216-8e51-47c5-a5c8-1dfe3aefcbee None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:53.829864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08216-8e51-47c5-a5c8-1dfe3aefcbee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:53.840888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd08216-8e51-47c5-a5c8-1dfe3aefcbee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:53.842320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd08216-8e51-47c5-a5c8-1dfe3aefcbee None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1cd08216-8e51-47c5-a5c8-1dfe3aefcbee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:53.856864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:53.857821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:53.858689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:53.858689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:53.858689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:53.862863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 278/555] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:53.864136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295e764-6d9c-4e41-b8e2-d49e2e3464f8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:53.864447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295e764-6d9c-4e41-b8e2-d49e2e3464f8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:53.864695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295e764-6d9c-4e41-b8e2-d49e2e3464f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:53.883190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7295e764-6d9c-4e41-b8e2-d49e2e3464f8 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:53.884405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7295e764-6d9c-4e41-b8e2-d49e2e3464f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:53.931979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 278/556] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:09:53.931979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe951559-b616-4f7e-91f5-0013545b058e None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:53.931979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe951559-b616-4f7e-91f5-0013545b058e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:53.931979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe951559-b616-4f7e-91f5-0013545b058e None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:53.934960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 279/557] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:53.935816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe951559-b616-4f7e-91f5-0013545b058e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:53.962599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 279/558] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:53.963593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295e764-6d9c-4e41-b8e2-d49e2e3464f8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:53.985837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:54.058220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe951559-b616-4f7e-91f5-0013545b058e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.084986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295e764-6d9c-4e41-b8e2-d49e2e3464f8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.088728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:54.095636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68b319-bf25-4a87-8a6b-c7ec2aead10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:54.096267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68b319-bf25-4a87-8a6b-c7ec2aead10c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.096593 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68b319-bf25-4a87-8a6b-c7ec2aead10c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.096869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68b319-bf25-4a87-8a6b-c7ec2aead10c None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.097520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68b319-bf25-4a87-8a6b-c7ec2aead10c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:54.097823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68b319-bf25-4a87-8a6b-c7ec2aead10c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:54.099211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68b319-bf25-4a87-8a6b-c7ec2aead10c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:54.115654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 280/559] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:54.116920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796e34-0859-49f1-a2d5-b26be142ff49 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.117208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796e34-0859-49f1-a2d5-b26be142ff49 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.117474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796e34-0859-49f1-a2d5-b26be142ff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.131784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2de33-b7fc-4b77-be38-eaabf1379062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:54.133209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2de33-b7fc-4b77-be38-eaabf1379062 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.133924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2de33-b7fc-4b77-be38-eaabf1379062 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.134368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2de33-b7fc-4b77-be38-eaabf1379062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.137648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ae796e34-0859-49f1-a2d5-b26be142ff49 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:54.138960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ae796e34-0859-49f1-a2d5-b26be142ff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:54.148068 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2de33-b7fc-4b77-be38-eaabf1379062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:54.150323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2de33-b7fc-4b77-be38-eaabf1379062 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-dbd2de33-b7fc-4b77-be38-eaabf1379062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:54.171138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:54.172135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:54.173230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:54.173230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:54.173230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:54.175521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 280/560] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:54.176873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2de33-b7fc-4b77-be38-eaabf1379062 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:54.230473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 281/561] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:54.230473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae796e34-0859-49f1-a2d5-b26be142ff49 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:54.283180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:54.310071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2de33-b7fc-4b77-be38-eaabf1379062 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.350585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5899f0-76e3-4865-b5d0-e220aca58a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:54.351266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5899f0-76e3-4865-b5d0-e220aca58a94 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.351674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5899f0-76e3-4865-b5d0-e220aca58a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.351954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5899f0-76e3-4865-b5d0-e220aca58a94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.363088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5899f0-76e3-4865-b5d0-e220aca58a94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:54.364867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5899f0-76e3-4865-b5d0-e220aca58a94 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:54.365489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae796e34-0859-49f1-a2d5-b26be142ff49 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bb5899f0-76e3-4865-b5d0-e220aca58a94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:09:54.378940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:54.379954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:54.380990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:54.380990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:54.380990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:09:54.380990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:09:54.380990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:09:54.380990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:09:54.380990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:09:54.380990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:09:54.380990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:09:54.380990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:54.383341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 281/562] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Sep 3 01:09:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:54.384189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5899f0-76e3-4865-b5d0-e220aca58a94 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:54.403732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:54.413783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7ae64-be4e-4fce-9b4a-eef136355a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:54.414484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ae64-be4e-4fce-9b4a-eef136355a71 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.414957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ae64-be4e-4fce-9b4a-eef136355a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.415103 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ae64-be4e-4fce-9b4a-eef136355a71 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.415685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7ae64-be4e-4fce-9b4a-eef136355a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:54.415974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7ae64-be4e-4fce-9b4a-eef136355a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:54.417347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7ae64-be4e-4fce-9b4a-eef136355a71 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:54.428427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 282/563] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:54.429221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7ae64-be4e-4fce-9b4a-eef136355a71 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:54.498006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5899f0-76e3-4865-b5d0-e220aca58a94 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.519196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:54.529325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7ae64-be4e-4fce-9b4a-eef136355a71 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.533219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6f665-c72a-42c4-b9ce-96f49a4632ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:54.533854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6f665-c72a-42c4-b9ce-96f49a4632ed None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.534134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6f665-c72a-42c4-b9ce-96f49a4632ed None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.534408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6f665-c72a-42c4-b9ce-96f49a4632ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.544530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6f665-c72a-42c4-b9ce-96f49a4632ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-73f6f665-c72a-42c4-b9ce-96f49a4632ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:54.551135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:54.552104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:54.552956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 282/564] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:54.553652 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf1c33-1df7-4da0-870f-41e7377a0ccb None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.553719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf1c33-1df7-4da0-870f-41e7377a0ccb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.554389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf1c33-1df7-4da0-870f-41e7377a0ccb None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.558461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 283/565] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:54.558461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf1c33-1df7-4da0-870f-41e7377a0ccb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:54.569330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f22cdd-2189-417e-b0f8-6648e4b00178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:54.569877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f22cdd-2189-417e-b0f8-6648e4b00178 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.570157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f22cdd-2189-417e-b0f8-6648e4b00178 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.570432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f22cdd-2189-417e-b0f8-6648e4b00178 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.571164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f22cdd-2189-417e-b0f8-6648e4b00178 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:54.571505 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f22cdd-2189-417e-b0f8-6648e4b00178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:54.572942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f22cdd-2189-417e-b0f8-6648e4b00178 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:54.589850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 283/566] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Sep 3 01:09:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:54.590644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f22cdd-2189-417e-b0f8-6648e4b00178 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:54.636697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:54.661301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf1c33-1df7-4da0-870f-41e7377a0ccb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.688099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f22cdd-2189-417e-b0f8-6648e4b00178 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.694109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5e5fd-b73e-4d86-811e-62c3edb2e887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:54.694735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5e5fd-b73e-4d86-811e-62c3edb2e887 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.695019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5e5fd-b73e-4d86-811e-62c3edb2e887 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.695304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5e5fd-b73e-4d86-811e-62c3edb2e887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.701801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5e5fd-b73e-4d86-811e-62c3edb2e887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:54.703236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5e5fd-b73e-4d86-811e-62c3edb2e887 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-32a5e5fd-b73e-4d86-811e-62c3edb2e887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:09:54.714562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:54.715752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:54.716655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:09:54.716655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:09:54.716655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:09:54.716655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:09:54.716655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:09:54.716655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:09:54.716655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:54.716655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:54.716655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 284/567] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:54.716655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5e5fd-b73e-4d86-811e-62c3edb2e887 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:54.727507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e848-f38a-4b60-af5d-614499a88149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:54.728183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e848-f38a-4b60-af5d-614499a88149 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.728466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e848-f38a-4b60-af5d-614499a88149 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.728736 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e848-f38a-4b60-af5d-614499a88149 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.739111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1e848-f38a-4b60-af5d-614499a88149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-e1f1e848-f38a-4b60-af5d-614499a88149 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:54.743917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:54.744845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:54.745670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 284/568] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:54.746512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ab819-7a71-4ab5-97f1-b79d9b278f3d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.746512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ab819-7a71-4ab5-97f1-b79d9b278f3d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.746643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ab819-7a71-4ab5-97f1-b79d9b278f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.764635 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7c7ab819-7a71-4ab5-97f1-b79d9b278f3d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:54.765828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7c7ab819-7a71-4ab5-97f1-b79d9b278f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:54.767964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:54.820071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5e5fd-b73e-4d86-811e-62c3edb2e887 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.832489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 285/569] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:54.833129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ab819-7a71-4ab5-97f1-b79d9b278f3d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:54.856177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72cbb3-8b00-4cdd-b05d-a83dd68081bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:54.856785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72cbb3-8b00-4cdd-b05d-a83dd68081bb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.857061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72cbb3-8b00-4cdd-b05d-a83dd68081bb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.857330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72cbb3-8b00-4cdd-b05d-a83dd68081bb None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.857990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72cbb3-8b00-4cdd-b05d-a83dd68081bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:54.858298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72cbb3-8b00-4cdd-b05d-a83dd68081bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:54.859681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72cbb3-8b00-4cdd-b05d-a83dd68081bb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:54.861878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:54.874345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 285/570] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:54.875091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72cbb3-8b00-4cdd-b05d-a83dd68081bb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:54.952272 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ab819-7a71-4ab5-97f1-b79d9b278f3d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.974934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72cbb3-8b00-4cdd-b05d-a83dd68081bb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:54.989254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de23ab-da5f-44fa-b1f2-cf90dfc74479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:54.990027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de23ab-da5f-44fa-b1f2-cf90dfc74479 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:54.990343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de23ab-da5f-44fa-b1f2-cf90dfc74479 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:54.990633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de23ab-da5f-44fa-b1f2-cf90dfc74479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:54.997501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:55.002876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de23ab-da5f-44fa-b1f2-cf90dfc74479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.004382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de23ab-da5f-44fa-b1f2-cf90dfc74479 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.011038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c930b-8947-49e6-bbb5-0e7dc1621f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.012019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c930b-8947-49e6-bbb5-0e7dc1621f4b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.012019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c930b-8947-49e6-bbb5-0e7dc1621f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.012190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c930b-8947-49e6-bbb5-0e7dc1621f4b None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.012890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c930b-8947-49e6-bbb5-0e7dc1621f4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:55.013193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c930b-8947-49e6-bbb5-0e7dc1621f4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.014606 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c930b-8947-49e6-bbb5-0e7dc1621f4b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-54de23ab-da5f-44fa-b1f2-cf90dfc74479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:55.020566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:55.021575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:55.022450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:55.022450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:55.022450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:55.026450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 286/571] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:55.027279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de23ab-da5f-44fa-b1f2-cf90dfc74479 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.033408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 286/572] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:09:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:55.033408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c930b-8947-49e6-bbb5-0e7dc1621f4b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.094689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:55.132114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de23ab-da5f-44fa-b1f2-cf90dfc74479 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.136318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c930b-8947-49e6-bbb5-0e7dc1621f4b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.165024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20827da-efda-4b84-b5c6-34f2eadc95e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.165617 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20827da-efda-4b84-b5c6-34f2eadc95e0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.165894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20827da-efda-4b84-b5c6-34f2eadc95e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.166164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20827da-efda-4b84-b5c6-34f2eadc95e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.166847 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20827da-efda-4b84-b5c6-34f2eadc95e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:55.167431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20827da-efda-4b84-b5c6-34f2eadc95e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.168659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969916e-5d75-4b84-8136-c495939c4d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.168809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20827da-efda-4b84-b5c6-34f2eadc95e0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.169287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969916e-5d75-4b84-8136-c495939c4d87 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.169567 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969916e-5d75-4b84-8136-c495939c4d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.169838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969916e-5d75-4b84-8136-c495939c4d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.177131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 287/573] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:55.177573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20827da-efda-4b84-b5c6-34f2eadc95e0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.182059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969916e-5d75-4b84-8136-c495939c4d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.183569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969916e-5d75-4b84-8136-c495939c4d87 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5969916e-5d75-4b84-8136-c495939c4d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:55.198683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:55.199718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:55.200579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:55.200579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:55.200579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:55.200579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 287/574] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:55.200579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969916e-5d75-4b84-8136-c495939c4d87 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.238021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:55.284657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20827da-efda-4b84-b5c6-34f2eadc95e0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.302754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969916e-5d75-4b84-8136-c495939c4d87 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.312882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:55.318277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbb364-9867-4138-9808-e0bca9ccbd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.318879 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb364-9867-4138-9808-e0bca9ccbd4c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.319153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb364-9867-4138-9808-e0bca9ccbd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.319460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb364-9867-4138-9808-e0bca9ccbd4c None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.320094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbb364-9867-4138-9808-e0bca9ccbd4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:55.320392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbb364-9867-4138-9808-e0bca9ccbd4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.321759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbb364-9867-4138-9808-e0bca9ccbd4c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.333253 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 288/575] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:55.334037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbb364-9867-4138-9808-e0bca9ccbd4c None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.339283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd9ad-6eb7-499e-b13d-d84ce3a5fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.339885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd9ad-6eb7-499e-b13d-d84ce3a5fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.340159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd9ad-6eb7-499e-b13d-d84ce3a5fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.340426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd9ad-6eb7-499e-b13d-d84ce3a5fdf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.341141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd9ad-6eb7-499e-b13d-d84ce3a5fdf3 None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=4a844df7e3574911b6ea31e7d7bee715) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:55.341441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd9ad-6eb7-499e-b13d-d84ce3a5fdf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.342848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd9ad-6eb7-499e-b13d-d84ce3a5fdf3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.348480 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 288/576] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/role_assignments?user.id=4a844df7e3574911b6ea31e7d7bee715&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:55.349192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd9ad-6eb7-499e-b13d-d84ce3a5fdf3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.452969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbb364-9867-4138-9808-e0bca9ccbd4c None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.460513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd9ad-6eb7-499e-b13d-d84ce3a5fdf3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.468284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:55.496095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140a19e-191a-4ebf-811f-b13bdb272000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.496543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140a19e-191a-4ebf-811f-b13bdb272000 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.496877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140a19e-191a-4ebf-811f-b13bdb272000 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.497086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140a19e-191a-4ebf-811f-b13bdb272000 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.497511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b5968-f768-4cec-a447-68b5ddfdc194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.498144 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b5968-f768-4cec-a447-68b5ddfdc194 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.499507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b5968-f768-4cec-a447-68b5ddfdc194 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.499507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b5968-f768-4cec-a447-68b5ddfdc194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.508658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140a19e-191a-4ebf-811f-b13bdb272000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:55.510192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b5968-f768-4cec-a447-68b5ddfdc194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.511674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b5968-f768-4cec-a447-68b5ddfdc194 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-c140a19e-191a-4ebf-811f-b13bdb272000 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:55.513529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:55.514489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:55.515343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:55.519574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 289/577] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:55.520380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140a19e-191a-4ebf-811f-b13bdb272000 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5c4b5968-f768-4cec-a447-68b5ddfdc194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:55.528856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:55.529804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:55.530683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:55.530683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:55.530683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:55.530683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 289/578] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:55.531995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b5968-f768-4cec-a447-68b5ddfdc194 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.564719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:55.631720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140a19e-191a-4ebf-811f-b13bdb272000 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.654399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b5968-f768-4cec-a447-68b5ddfdc194 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.667277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e0ac-62a8-4bff-8c58-1880a7f50dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.667991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e0ac-62a8-4bff-8c58-1880a7f50dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.668382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e0ac-62a8-4bff-8c58-1880a7f50dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.668748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e0ac-62a8-4bff-8c58-1880a7f50dd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.669470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828e0ac-62a8-4bff-8c58-1880a7f50dd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:55.669830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828e0ac-62a8-4bff-8c58-1880a7f50dd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.671281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828e0ac-62a8-4bff-8c58-1880a7f50dd6 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.683830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 290/579] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:55.684544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e0ac-62a8-4bff-8c58-1880a7f50dd6 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.699873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d93c4-aef9-4b1f-a6c0-f8ab06b49f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.700635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d93c4-aef9-4b1f-a6c0-f8ab06b49f98 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.701010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d93c4-aef9-4b1f-a6c0-f8ab06b49f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.701381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d93c4-aef9-4b1f-a6c0-f8ab06b49f98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.708871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d93c4-aef9-4b1f-a6c0-f8ab06b49f98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.710437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d93c4-aef9-4b1f-a6c0-f8ab06b49f98 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.720859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-275d93c4-aef9-4b1f-a6c0-f8ab06b49f98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:09:55.722971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:55.724593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:55.725720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:09:55.725720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:09:55.725720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:09:55.725720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:09:55.725720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:09:55.725720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:09:55.725720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:55.725720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:55.731193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 290/580] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:55.732074 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d93c4-aef9-4b1f-a6c0-f8ab06b49f98 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.796666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e0ac-62a8-4bff-8c58-1880a7f50dd6 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.821119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:55.831375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca18b-c08b-482f-ae0e-c018fdb05311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.832102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca18b-c08b-482f-ae0e-c018fdb05311 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.832481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca18b-c08b-482f-ae0e-c018fdb05311 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.832846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca18b-c08b-482f-ae0e-c018fdb05311 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.833508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca18b-c08b-482f-ae0e-c018fdb05311 None admin] RBAC: Adding query filter params (name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:55.833813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca18b-c08b-482f-ae0e-c018fdb05311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.835174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca18b-c08b-482f-ae0e-c018fdb05311 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.838858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d93c4-aef9-4b1f-a6c0-f8ab06b49f98 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.843568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 291/581] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:55.847674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca18b-c08b-482f-ae0e-c018fdb05311 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.877097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19dee6-720e-4a04-8986-591ffe08aba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:55.877712 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19dee6-720e-4a04-8986-591ffe08aba5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:55.877990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19dee6-720e-4a04-8986-591ffe08aba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:55.878260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19dee6-720e-4a04-8986-591ffe08aba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:55.878909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19dee6-720e-4a04-8986-591ffe08aba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:55.879205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19dee6-720e-4a04-8986-591ffe08aba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:55.880680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19dee6-720e-4a04-8986-591ffe08aba5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:55.896954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 291/582] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:55.896954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19dee6-720e-4a04-8986-591ffe08aba5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:55.954209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:55.962661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca18b-c08b-482f-ae0e-c018fdb05311 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:55.998841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19dee6-720e-4a04-8986-591ffe08aba5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.000692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352314-a6a5-4499-89a6-2eadb217e26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.002160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352314-a6a5-4499-89a6-2eadb217e26d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.002160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352314-a6a5-4499-89a6-2eadb217e26d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.002160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352314-a6a5-4499-89a6-2eadb217e26d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.009576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352314-a6a5-4499-89a6-2eadb217e26d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.011017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352314-a6a5-4499-89a6-2eadb217e26d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-ff352314-a6a5-4499-89a6-2eadb217e26d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:09:56.023192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:56.024365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:56.025535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:56.025535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:56.025535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:09:56.025535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:09:56.025535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:09:56.025535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:09:56.025535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:09:56.025535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:09:56.025535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 01:09:56.025535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:56.029016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 292/583] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:56.029948 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352314-a6a5-4499-89a6-2eadb217e26d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:56.037515 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4a79e-9ef4-4f05-9f62-e2af2fa0d0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.038189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a79e-9ef4-4f05-9f62-e2af2fa0d0fc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.038522 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a79e-9ef4-4f05-9f62-e2af2fa0d0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.038850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a79e-9ef4-4f05-9f62-e2af2fa0d0fc None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.039636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4a79e-9ef4-4f05-9f62-e2af2fa0d0fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:56.039994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4a79e-9ef4-4f05-9f62-e2af2fa0d0fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.041474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4a79e-9ef4-4f05-9f62-e2af2fa0d0fc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.053374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 292/584] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:09:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:56.054405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4a79e-9ef4-4f05-9f62-e2af2fa0d0fc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:56.063761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:56.136375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352314-a6a5-4499-89a6-2eadb217e26d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.158139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4a79e-9ef4-4f05-9f62-e2af2fa0d0fc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.169610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b43c0e-e509-4dee-9725-b09aea38d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.170233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43c0e-e509-4dee-9725-b09aea38d610 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.170506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43c0e-e509-4dee-9725-b09aea38d610 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.170774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43c0e-e509-4dee-9725-b09aea38d610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.182939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b43c0e-e509-4dee-9725-b09aea38d610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.184461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b43c0e-e509-4dee-9725-b09aea38d610 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.193404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8ef28-5db8-43b4-aac4-9bcf94f75bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.194049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8ef28-5db8-43b4-aac4-9bcf94f75bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.194327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8ef28-5db8-43b4-aac4-9bcf94f75bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.194596 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8ef28-5db8-43b4-aac4-9bcf94f75bd0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.202411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8ef28-5db8-43b4-aac4-9bcf94f75bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-b0b43c0e-e509-4dee-9725-b09aea38d610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:56.202832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:56.203833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:56.204919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:56.204919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:56.204919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:56.205087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8ef28-5db8-43b4-aac4-9bcf94f75bd0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.207421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 293/585] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:56.209088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b43c0e-e509-4dee-9725-b09aea38d610 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d5a8ef28-5db8-43b4-aac4-9bcf94f75bd0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:09:56.217091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:56.218006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:56.218915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 293/586] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:09:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:56.219561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8ef28-5db8-43b4-aac4-9bcf94f75bd0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:56.225052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:56.293704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:56.319615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b43c0e-e509-4dee-9725-b09aea38d610 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.333685 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8ef28-5db8-43b4-aac4-9bcf94f75bd0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.356424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91a52c-3576-4af6-80c6-a59ad92db8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.357029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a52c-3576-4af6-80c6-a59ad92db8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.357303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a52c-3576-4af6-80c6-a59ad92db8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.357571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a52c-3576-4af6-80c6-a59ad92db8c4 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.358319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a52c-3576-4af6-80c6-a59ad92db8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:56.358619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a52c-3576-4af6-80c6-a59ad92db8c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.360084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a52c-3576-4af6-80c6-a59ad92db8c4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.371706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc99479-202b-48db-ae18-7771cf4d26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.372374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc99479-202b-48db-ae18-7771cf4d26a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.372653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc99479-202b-48db-ae18-7771cf4d26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.372925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc99479-202b-48db-ae18-7771cf4d26a3 None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/9c4076fd5abc4b508a0215ce22af85d6/roles/76b5fcb0eb664fb2b2812e427e7f9390` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.378226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 294/587] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Sep 3 01:09:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:56.380150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91a52c-3576-4af6-80c6-a59ad92db8c4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:56.388709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc99479-202b-48db-ae18-7771cf4d26a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=9c4076fd5abc4b508a0215ce22af85d6, role_id=76b5fcb0eb664fb2b2812e427e7f9390)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.390155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc99479-202b-48db-ae18-7771cf4d26a3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.404920 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 294/588] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:09:56 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/9c4076fd5abc4b508a0215ce22af85d6/roles/76b5fcb0eb664fb2b2812e427e7f9390 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:56.405728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc99479-202b-48db-ae18-7771cf4d26a3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:56.479600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:56.531544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91a52c-3576-4af6-80c6-a59ad92db8c4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.547663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc99479-202b-48db-ae18-7771cf4d26a3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.569615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:56.585175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96423aef-644c-4198-ac21-ce2dd04d60dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.585791 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96423aef-644c-4198-ac21-ce2dd04d60dc None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.586067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96423aef-644c-4198-ac21-ce2dd04d60dc None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.586336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96423aef-644c-4198-ac21-ce2dd04d60dc None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.586986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96423aef-644c-4198-ac21-ce2dd04d60dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:56.587807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96423aef-644c-4198-ac21-ce2dd04d60dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.588747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96423aef-644c-4198-ac21-ce2dd04d60dc None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.593741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67539442-5a42-4250-88f3-3fdf8cd3d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.594360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67539442-5a42-4250-88f3-3fdf8cd3d217 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.594703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67539442-5a42-4250-88f3-3fdf8cd3d217 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.595455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67539442-5a42-4250-88f3-3fdf8cd3d217 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.595894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67539442-5a42-4250-88f3-3fdf8cd3d217 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:56.596201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67539442-5a42-4250-88f3-3fdf8cd3d217 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.598335 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67539442-5a42-4250-88f3-3fdf8cd3d217 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.606577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 295/589] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:56.607467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96423aef-644c-4198-ac21-ce2dd04d60dc None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:56.617252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 295/590] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Sep 3 01:09:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:56.618105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67539442-5a42-4250-88f3-3fdf8cd3d217 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:56.724868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96423aef-644c-4198-ac21-ce2dd04d60dc None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.750889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:56.751664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67539442-5a42-4250-88f3-3fdf8cd3d217 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.766231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46307731-14cc-4862-bb64-0e5f83e2167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.767125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46307731-14cc-4862-bb64-0e5f83e2167f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.767525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46307731-14cc-4862-bb64-0e5f83e2167f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.767809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46307731-14cc-4862-bb64-0e5f83e2167f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.783264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46307731-14cc-4862-bb64-0e5f83e2167f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.785480 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46307731-14cc-4862-bb64-0e5f83e2167f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.791824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c7378-7b78-4d9f-81d7-bbc7c64c93a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.792704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c7378-7b78-4d9f-81d7-bbc7c64c93a9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.793121 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c7378-7b78-4d9f-81d7-bbc7c64c93a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.793526 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c7378-7b78-4d9f-81d7-bbc7c64c93a9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.802457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c7378-7b78-4d9f-81d7-bbc7c64c93a9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-46307731-14cc-4862-bb64-0e5f83e2167f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:56.803058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:56.804251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:56.805470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:56.805470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:56.805470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:56.805470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 296/591] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:56.805470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46307731-14cc-4862-bb64-0e5f83e2167f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:56.807025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c7378-7b78-4d9f-81d7-bbc7c64c93a9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f10c7378-7b78-4d9f-81d7-bbc7c64c93a9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:09:56.822261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:56.823470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:56.824390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:56.824390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:56.824390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:09:56.824390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:09:56.824390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:09:56.824390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:09:56.824390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:09:56.824390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:09:56.824390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 01:09:56.824390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:56.826754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 296/592] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:56.827894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c7378-7b78-4d9f-81d7-bbc7c64c93a9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:56.866128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:56.940223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46307731-14cc-4862-bb64-0e5f83e2167f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.946348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c7378-7b78-4d9f-81d7-bbc7c64c93a9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:56.977650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb0cfe-ff0f-4e66-9188-55069745a6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.978735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb0cfe-ff0f-4e66-9188-55069745a6ef None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.979232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb0cfe-ff0f-4e66-9188-55069745a6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.979720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb0cfe-ff0f-4e66-9188-55069745a6ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.990412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7117c-399f-41e8-9ace-767632a8a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:56.991530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7117c-399f-41e8-9ace-767632a8a858 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:56.991813 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7117c-399f-41e8-9ace-767632a8a858 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:56.992095 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7117c-399f-41e8-9ace-767632a8a858 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:56.992915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7117c-399f-41e8-9ace-767632a8a858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:56.993316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7117c-399f-41e8-9ace-767632a8a858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.993995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb0cfe-ff0f-4e66-9188-55069745a6ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:56.994697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7117c-399f-41e8-9ace-767632a8a858 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:56.995893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb0cfe-ff0f-4e66-9188-55069745a6ef None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:57.009108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 297/593] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:57.009949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7117c-399f-41e8-9ace-767632a8a858 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-a8eb0cfe-ff0f-4e66-9188-55069745a6ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:57.013242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:57.014158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:57.015060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:57.015060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:57.015060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:57.017932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 297/594] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:57.019061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb0cfe-ff0f-4e66-9188-55069745a6ef None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:57.051927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:57.130105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb0cfe-ff0f-4e66-9188-55069745a6ef None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:57.137841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:57.147553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7117c-399f-41e8-9ace-767632a8a858 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:57.167136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cfb7c-fd5d-4fa8-9f96-92f2d55d1443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:57.168104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cfb7c-fd5d-4fa8-9f96-92f2d55d1443 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:57.168585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cfb7c-fd5d-4fa8-9f96-92f2d55d1443 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:57.169081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cfb7c-fd5d-4fa8-9f96-92f2d55d1443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:57.176390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cfb7c-fd5d-4fa8-9f96-92f2d55d1443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:57.178080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cfb7c-fd5d-4fa8-9f96-92f2d55d1443 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:57.184810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8ac52-cffd-4a75-befe-431c47b9f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:57.185432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8ac52-cffd-4a75-befe-431c47b9f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:57.185712 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8ac52-cffd-4a75-befe-431c47b9f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:57.185986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8ac52-cffd-4a75-befe-431c47b9f7b1 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:57.186727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8ac52-cffd-4a75-befe-431c47b9f7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:57.187036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8ac52-cffd-4a75-befe-431c47b9f7b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:57.188702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8ac52-cffd-4a75-befe-431c47b9f7b1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-644cfb7c-fd5d-4fa8-9f96-92f2d55d1443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:09:57.193213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:57.194061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:57.194939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:09:57.194939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:09:57.194939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:09:57.194939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:09:57.194939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:09:57.194939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:09:57.194939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:57.194939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:57.197670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 298/595] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:57.198763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cfb7c-fd5d-4fa8-9f96-92f2d55d1443 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:57.207880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 298/596] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Sep 3 01:09:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:57.208747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8ac52-cffd-4a75-befe-431c47b9f7b1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:57.292689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:57.308843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cfb7c-fd5d-4fa8-9f96-92f2d55d1443 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:57.323931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8ac52-cffd-4a75-befe-431c47b9f7b1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:57.350628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdd3e0-6f95-492e-9daf-50976f1d23ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:57.351277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdd3e0-6f95-492e-9daf-50976f1d23ed None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:57.351577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdd3e0-6f95-492e-9daf-50976f1d23ed None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:57.351799 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdd3e0-6f95-492e-9daf-50976f1d23ed None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:57.352571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdd3e0-6f95-492e-9daf-50976f1d23ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:57.352765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdd3e0-6f95-492e-9daf-50976f1d23ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:57.354098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdd3e0-6f95-492e-9daf-50976f1d23ed None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:57.361141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4989d5-f77a-4b5b-a93d-cf03a810cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:57.361771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4989d5-f77a-4b5b-a93d-cf03a810cd00 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:57.362019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4989d5-f77a-4b5b-a93d-cf03a810cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:57.362338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4989d5-f77a-4b5b-a93d-cf03a810cd00 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:57.363033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4989d5-f77a-4b5b-a93d-cf03a810cd00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:57.363364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4989d5-f77a-4b5b-a93d-cf03a810cd00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:57.364754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4989d5-f77a-4b5b-a93d-cf03a810cd00 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:57.371094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 299/597] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:57.371094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdd3e0-6f95-492e-9daf-50976f1d23ed None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:57.381668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 299/598] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:57.383882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f2f5b-a30a-4851-8f10-8737b19b93c4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:57.384395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f2f5b-a30a-4851-8f10-8737b19b93c4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:57.384996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f2f5b-a30a-4851-8f10-8737b19b93c4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:57.387030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 300/599] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:57.387978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f2f5b-a30a-4851-8f10-8737b19b93c4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:57.403760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:57.479506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdd3e0-6f95-492e-9daf-50976f1d23ed None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:57.494855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f2f5b-a30a-4851-8f10-8737b19b93c4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:57.515282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0e713-46d9-473e-8e2a-5b5c0b3ee611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:57.515934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e713-46d9-473e-8e2a-5b5c0b3ee611 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:57.516215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e713-46d9-473e-8e2a-5b5c0b3ee611 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:57.516474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e713-46d9-473e-8e2a-5b5c0b3ee611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:57.527611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0e713-46d9-473e-8e2a-5b5c0b3ee611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:57.529257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0e713-46d9-473e-8e2a-5b5c0b3ee611 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:57.530108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e70bfd-aee7-4da7-8674-145a63edf589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:57.530749 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e70bfd-aee7-4da7-8674-145a63edf589 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:57.531029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e70bfd-aee7-4da7-8674-145a63edf589 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:57.531330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e70bfd-aee7-4da7-8674-145a63edf589 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:57.537986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e70bfd-aee7-4da7-8674-145a63edf589 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:57.538570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:57.539459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e70bfd-aee7-4da7-8674-145a63edf589 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-efd0e713-46d9-473e-8e2a-5b5c0b3ee611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:57.546636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:57.547679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:57.548561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:57.548561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:57.548561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:57.553146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 300/600] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c7e70bfd-aee7-4da7-8674-145a63edf589 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:09:57.553346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:57.554728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:57.556417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:09:57.556417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:09:57.556417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:09:57.556417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:09:57.556417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:09:57.556417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:09:57.556417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:57.556417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:57.557421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0e713-46d9-473e-8e2a-5b5c0b3ee611 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:57.558452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 301/601] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:57.559897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185105-8b59-4aa7-81ad-ed747d4bb1fa None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:57.560204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185105-8b59-4aa7-81ad-ed747d4bb1fa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:57.560459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185105-8b59-4aa7-81ad-ed747d4bb1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:57.585142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8e185105-8b59-4aa7-81ad-ed747d4bb1fa None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:57.586338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8e185105-8b59-4aa7-81ad-ed747d4bb1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:57.659327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 302/602] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:09:57.659327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e185105-8b59-4aa7-81ad-ed747d4bb1fa None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:57.659327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:57.674705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0e713-46d9-473e-8e2a-5b5c0b3ee611 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:57.717777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10888ab6-777a-45df-a909-f1d52acf2458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:57.718954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10888ab6-777a-45df-a909-f1d52acf2458 None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:57.719483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10888ab6-777a-45df-a909-f1d52acf2458 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:57.720283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10888ab6-777a-45df-a909-f1d52acf2458 None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/248ccaa14fce4726826a16c4d3e6ca54/roles/76b5fcb0eb664fb2b2812e427e7f9390` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:57.741296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10888ab6-777a-45df-a909-f1d52acf2458 None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=248ccaa14fce4726826a16c4d3e6ca54, role_id=76b5fcb0eb664fb2b2812e427e7f9390)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:57.742756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10888ab6-777a-45df-a909-f1d52acf2458 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:57.765872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 301/603] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:09:57 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/248ccaa14fce4726826a16c4d3e6ca54/roles/76b5fcb0eb664fb2b2812e427e7f9390 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:57.767206 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10888ab6-777a-45df-a909-f1d52acf2458 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:57.778183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e185105-8b59-4aa7-81ad-ed747d4bb1fa None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:57.818255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15867b60-ef29-429e-8928-f659eb44d6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:57.819236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867b60-ef29-429e-8928-f659eb44d6ab None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:57.819801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867b60-ef29-429e-8928-f659eb44d6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:57.820268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867b60-ef29-429e-8928-f659eb44d6ab None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:57.821142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15867b60-ef29-429e-8928-f659eb44d6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:57.821714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15867b60-ef29-429e-8928-f659eb44d6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:57.823392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15867b60-ef29-429e-8928-f659eb44d6ab None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:57.845158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 303/604] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:57.849951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15867b60-ef29-429e-8928-f659eb44d6ab None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:57.883955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:57.924691 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:57.969104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15867b60-ef29-429e-8928-f659eb44d6ab None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:57.982672 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10888ab6-777a-45df-a909-f1d52acf2458 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:58.009819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43625363-23fe-472f-995f-02b552fefa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:58.010454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43625363-23fe-472f-995f-02b552fefa14 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:58.010729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43625363-23fe-472f-995f-02b552fefa14 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:58.010999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43625363-23fe-472f-995f-02b552fefa14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:58.017770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43625363-23fe-472f-995f-02b552fefa14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:58.019160 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43625363-23fe-472f-995f-02b552fefa14 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:58.022249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688afa15-28a9-4451-8db8-39667cf95604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:58.022933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688afa15-28a9-4451-8db8-39667cf95604 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:58.023334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688afa15-28a9-4451-8db8-39667cf95604 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:58.023622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688afa15-28a9-4451-8db8-39667cf95604 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:58.024379 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688afa15-28a9-4451-8db8-39667cf95604 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:58.024740 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688afa15-28a9-4451-8db8-39667cf95604 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:58.026521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688afa15-28a9-4451-8db8-39667cf95604 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-43625363-23fe-472f-995f-02b552fefa14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:09:58.030512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:58.031569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:58.032774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:09:58.032774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:09:58.032774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:09:58.032774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:09:58.032774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:09:58.032774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:09:58.032774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:09:58.032774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:58.032774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 304/605] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:58.032774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43625363-23fe-472f-995f-02b552fefa14 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:58.045402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 302/606] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:58.045402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688afa15-28a9-4451-8db8-39667cf95604 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:58.164703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688afa15-28a9-4451-8db8-39667cf95604 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:58.169638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43625363-23fe-472f-995f-02b552fefa14 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:58.176827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:58.205915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:58.207383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05a80a-7bb7-4882-8abf-02fed970271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:58.208372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05a80a-7bb7-4882-8abf-02fed970271e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:58.208841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05a80a-7bb7-4882-8abf-02fed970271e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:58.209299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05a80a-7bb7-4882-8abf-02fed970271e None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:58.210317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05a80a-7bb7-4882-8abf-02fed970271e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:58.210810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05a80a-7bb7-4882-8abf-02fed970271e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:58.212503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05a80a-7bb7-4882-8abf-02fed970271e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:58.219819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bdb4d-b83c-46f3-b1ff-174062c8cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:58.220458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bdb4d-b83c-46f3-b1ff-174062c8cc6c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:58.220730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bdb4d-b83c-46f3-b1ff-174062c8cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:58.220995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bdb4d-b83c-46f3-b1ff-174062c8cc6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:58.227358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 303/607] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:09:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:58.228483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05a80a-7bb7-4882-8abf-02fed970271e None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:58.234892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bdb4d-b83c-46f3-b1ff-174062c8cc6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-fc9bdb4d-b83c-46f3-b1ff-174062c8cc6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:58.241257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:58.242163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:58.243015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 305/608] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:58.247521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bdb4d-b83c-46f3-b1ff-174062c8cc6c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:58.360610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05a80a-7bb7-4882-8abf-02fed970271e None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:58.370791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bdb4d-b83c-46f3-b1ff-174062c8cc6c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:58.401776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad3599-0525-4e27-a458-78af27195e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:58.402815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad3599-0525-4e27-a458-78af27195e92 None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:58.403313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad3599-0525-4e27-a458-78af27195e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:58.404155 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad3599-0525-4e27-a458-78af27195e92 None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/54131719962e4463b0b874916cb40973/roles/76b5fcb0eb664fb2b2812e427e7f9390` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:58.414306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bb650-8a24-452d-9550-619344f467d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:58.415086 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bb650-8a24-452d-9550-619344f467d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:58.415384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bb650-8a24-452d-9550-619344f467d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:58.415659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bb650-8a24-452d-9550-619344f467d6 None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/8bec5c8c626c40ef9906783916c49dd5/roles/76b5fcb0eb664fb2b2812e427e7f9390` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:58.421199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad3599-0525-4e27-a458-78af27195e92 None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=54131719962e4463b0b874916cb40973, role_id=76b5fcb0eb664fb2b2812e427e7f9390)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:58.423089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad3599-0525-4e27-a458-78af27195e92 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:58.434117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bb650-8a24-452d-9550-619344f467d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=8bec5c8c626c40ef9906783916c49dd5, role_id=76b5fcb0eb664fb2b2812e427e7f9390)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:58.435556 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bb650-8a24-452d-9550-619344f467d6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:58.439642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 304/609] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:09:58 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/54131719962e4463b0b874916cb40973/roles/76b5fcb0eb664fb2b2812e427e7f9390 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:58.440493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad3599-0525-4e27-a458-78af27195e92 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:58.461978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 306/610] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:09:58 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/8bec5c8c626c40ef9906783916c49dd5/roles/76b5fcb0eb664fb2b2812e427e7f9390 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:09:58.464009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36561290-2cd5-49ec-80f1-b495cb1cadb2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:58.464580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36561290-2cd5-49ec-80f1-b495cb1cadb2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:58.465868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:58.466902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36561290-2cd5-49ec-80f1-b495cb1cadb2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:58.473754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 307/611] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:09:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:09:58.476971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f787ac-33aa-4ae9-b802-e005d524a9f2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:58.477717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f787ac-33aa-4ae9-b802-e005d524a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:58.478193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f787ac-33aa-4ae9-b802-e005d524a9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:58.500486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d8f787ac-33aa-4ae9-b802-e005d524a9f2 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:09:58.502835 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d8f787ac-33aa-4ae9-b802-e005d524a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:09:58.536515 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:58.567814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad3599-0525-4e27-a458-78af27195e92 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:58.587036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 308/612] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:09:58.608022 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35e5af-fa76-415f-a418-c368e9ef2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:58.608649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35e5af-fa76-415f-a418-c368e9ef2cee None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:58.608934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35e5af-fa76-415f-a418-c368e9ef2cee None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:58.609203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35e5af-fa76-415f-a418-c368e9ef2cee None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:58.609882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35e5af-fa76-415f-a418-c368e9ef2cee None admin] RBAC: Adding query filter params (name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:58.610350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35e5af-fa76-415f-a418-c368e9ef2cee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:58.611804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35e5af-fa76-415f-a418-c368e9ef2cee None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:58.622314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 305/613] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:58.627870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f787ac-33aa-4ae9-b802-e005d524a9f2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:58.738461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f787ac-33aa-4ae9-b802-e005d524a9f2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:58.773688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429feddc-7310-4101-91c6-970ea9bbe5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:58.774333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429feddc-7310-4101-91c6-970ea9bbe5cc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:58.774609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429feddc-7310-4101-91c6-970ea9bbe5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:58.774877 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429feddc-7310-4101-91c6-970ea9bbe5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:58.785680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429feddc-7310-4101-91c6-970ea9bbe5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:58.787182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429feddc-7310-4101-91c6-970ea9bbe5cc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-429feddc-7310-4101-91c6-970ea9bbe5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:58.802810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:58.803810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:58.805283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:58.805283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:58.805283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:58.805283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 309/614] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:58.809564 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35e5af-fa76-415f-a418-c368e9ef2cee None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:58.941709 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:58.943861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429feddc-7310-4101-91c6-970ea9bbe5cc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:58.960357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35e5af-fa76-415f-a418-c368e9ef2cee None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:58.970633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:59.021408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4bd4a-2ada-41f4-bb7c-ddaeb9aa16dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:59.021932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4bd4a-2ada-41f4-bb7c-ddaeb9aa16dd None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:59.022210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4bd4a-2ada-41f4-bb7c-ddaeb9aa16dd None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:59.022481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4bd4a-2ada-41f4-bb7c-ddaeb9aa16dd None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:59.023126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4bd4a-2ada-41f4-bb7c-ddaeb9aa16dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:59.023448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4bd4a-2ada-41f4-bb7c-ddaeb9aa16dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:59.024877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4bd4a-2ada-41f4-bb7c-ddaeb9aa16dd None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:59.050106 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 306/615] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:59.055281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4bd4a-2ada-41f4-bb7c-ddaeb9aa16dd None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:59.069886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429feddc-7310-4101-91c6-970ea9bbe5cc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:59.142400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49f5c8-f8e7-4c8c-81c7-d2bba29617f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:59.144186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49f5c8-f8e7-4c8c-81c7-d2bba29617f4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:59.144854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49f5c8-f8e7-4c8c-81c7-d2bba29617f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:59.146515 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49f5c8-f8e7-4c8c-81c7-d2bba29617f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:59.164181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49f5c8-f8e7-4c8c-81c7-d2bba29617f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5a49f5c8-f8e7-4c8c-81c7-d2bba29617f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:09:59.172483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:59.173421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:09:59.174266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:59.182407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 310/616] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:09:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:09:59.185821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49f5c8-f8e7-4c8c-81c7-d2bba29617f4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:59.260448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4bd4a-2ada-41f4-bb7c-ddaeb9aa16dd None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:59.302451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:59.334754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5c259-9e66-48d4-abcd-55bc6eb5a0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:59.335423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5c259-9e66-48d4-abcd-55bc6eb5a0aa None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:59.335751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5c259-9e66-48d4-abcd-55bc6eb5a0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:59.336029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5c259-9e66-48d4-abcd-55bc6eb5a0aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:59.337501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49f5c8-f8e7-4c8c-81c7-d2bba29617f4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:59.351158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5c259-9e66-48d4-abcd-55bc6eb5a0aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:59.352658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5c259-9e66-48d4-abcd-55bc6eb5a0aa None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-6cf5c259-9e66-48d4-abcd-55bc6eb5a0aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:09:59.382446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:59.384219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:59.385456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 307/617] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:09:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:59.389257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5c259-9e66-48d4-abcd-55bc6eb5a0aa None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:59.394552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:59.400109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f7e39-8156-41f2-aa93-abb1220289cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:59.400731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f7e39-8156-41f2-aa93-abb1220289cf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:59.401010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f7e39-8156-41f2-aa93-abb1220289cf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:59.401277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f7e39-8156-41f2-aa93-abb1220289cf None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:59.403418 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f7e39-8156-41f2-aa93-abb1220289cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:59.403728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f7e39-8156-41f2-aa93-abb1220289cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:59.405090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f7e39-8156-41f2-aa93-abb1220289cf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:59.426821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 311/618] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:09:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:59.432290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f7e39-8156-41f2-aa93-abb1220289cf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:59.543763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5c259-9e66-48d4-abcd-55bc6eb5a0aa None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:59.584780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25c0aa-10f3-414c-b9a4-404218b1eaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:59.585402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25c0aa-10f3-414c-b9a4-404218b1eaa8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:59.585684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25c0aa-10f3-414c-b9a4-404218b1eaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:59.585954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25c0aa-10f3-414c-b9a4-404218b1eaa8 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:59.586690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25c0aa-10f3-414c-b9a4-404218b1eaa8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:09:59.586994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25c0aa-10f3-414c-b9a4-404218b1eaa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:59.593428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25c0aa-10f3-414c-b9a4-404218b1eaa8 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:59.630939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 308/619] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Sep 3 01:09:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:09:59.636031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25c0aa-10f3-414c-b9a4-404218b1eaa8 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:59.640696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f7e39-8156-41f2-aa93-abb1220289cf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:59.688578 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9c80a-8fdf-4871-b6fa-1bd58afc4a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:59.689236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9c80a-8fdf-4871-b6fa-1bd58afc4a63 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:59.689514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9c80a-8fdf-4871-b6fa-1bd58afc4a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:59.689783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9c80a-8fdf-4871-b6fa-1bd58afc4a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:59.694996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:59.712937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9c80a-8fdf-4871-b6fa-1bd58afc4a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:59.717800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9c80a-8fdf-4871-b6fa-1bd58afc4a63 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f5c9c80a-8fdf-4871-b6fa-1bd58afc4a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:59.742097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:59.743128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:59.744049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:59.744049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:59.744049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:09:59.744228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 312/620] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:59.748903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9c80a-8fdf-4871-b6fa-1bd58afc4a63 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:59.771894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:09:59.871112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25c0aa-10f3-414c-b9a4-404218b1eaa8 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:59.915170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9c80a-8fdf-4871-b6fa-1bd58afc4a63 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:09:59.938882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef87b6-51b0-4ed3-89ff-ec03ef1a5fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:59.939549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef87b6-51b0-4ed3-89ff-ec03ef1a5fac None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:59.939835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef87b6-51b0-4ed3-89ff-ec03ef1a5fac None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:59.940110 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef87b6-51b0-4ed3-89ff-ec03ef1a5fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:09:59.950899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef87b6-51b0-4ed3-89ff-ec03ef1a5fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:09:59.952765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef87b6-51b0-4ed3-89ff-ec03ef1a5fac None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-bdef87b6-51b0-4ed3-89ff-ec03ef1a5fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:09:59.968086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:09:59.969035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:09:59.969942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:09:59.969942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:09:59.969942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:09:59.969942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 309/621] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:09:59.977973 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef87b6-51b0-4ed3-89ff-ec03ef1a5fac None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:09:59.996780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310730-2dee-401e-be05-ff0dc9b750f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:09:59.997691 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310730-2dee-401e-be05-ff0dc9b750f6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:09:59.998157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310730-2dee-401e-be05-ff0dc9b750f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:09:59.998677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310730-2dee-401e-be05-ff0dc9b750f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.000200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c310730-2dee-401e-be05-ff0dc9b750f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:00.000888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c310730-2dee-401e-be05-ff0dc9b750f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:00.003690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c310730-2dee-401e-be05-ff0dc9b750f6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:00.027153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 313/622] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:00.031073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310730-2dee-401e-be05-ff0dc9b750f6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:00.105979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:00.140189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef87b6-51b0-4ed3-89ff-ec03ef1a5fac None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:00.156982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:00.162394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310730-2dee-401e-be05-ff0dc9b750f6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:00.185607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf6b82-e5b2-4cbf-a781-9dfd03e51968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:00.186514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf6b82-e5b2-4cbf-a781-9dfd03e51968 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.186985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf6b82-e5b2-4cbf-a781-9dfd03e51968 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.187912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf6b82-e5b2-4cbf-a781-9dfd03e51968 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.189273 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf6b82-e5b2-4cbf-a781-9dfd03e51968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:00.189775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf6b82-e5b2-4cbf-a781-9dfd03e51968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:00.192006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf6b82-e5b2-4cbf-a781-9dfd03e51968 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:00.204906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f01006-7b02-4cea-a777-8c05d80a0ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:00.205548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01006-7b02-4cea-a777-8c05d80a0ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.205828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01006-7b02-4cea-a777-8c05d80a0ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.206099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01006-7b02-4cea-a777-8c05d80a0ea1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.213293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 310/623] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:00.213293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bea892-b8ca-4ade-9750-ad39059c2c10 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.213293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bea892-b8ca-4ade-9750-ad39059c2c10 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.213293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bea892-b8ca-4ade-9750-ad39059c2c10 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.214718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 311/624] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:00.219473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bea892-b8ca-4ade-9750-ad39059c2c10 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:00.220635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f01006-7b02-4cea-a777-8c05d80a0ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:00.222083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f01006-7b02-4cea-a777-8c05d80a0ea1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-34f01006-7b02-4cea-a777-8c05d80a0ea1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:00.235637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:00.236645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:00.237598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 314/625] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Sep 3 01:10:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:00.238707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606fe35-c981-4480-a309-a4434b74c9f1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.238707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606fe35-c981-4480-a309-a4434b74c9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.238992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606fe35-c981-4480-a309-a4434b74c9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.258875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6606fe35-c981-4480-a309-a4434b74c9f1 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:00.260213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6606fe35-c981-4480-a309-a4434b74c9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:00.340694 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bea892-b8ca-4ade-9750-ad39059c2c10 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:00.351347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 315/626] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:00.351347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606fe35-c981-4480-a309-a4434b74c9f1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:00.406616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07127e9a-327f-4627-9744-2e61fd8ca597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:00.409229 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07127e9a-327f-4627-9744-2e61fd8ca597 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.409511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07127e9a-327f-4627-9744-2e61fd8ca597 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.409780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07127e9a-327f-4627-9744-2e61fd8ca597 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.421578 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:00.425025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07127e9a-327f-4627-9744-2e61fd8ca597 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:00.427022 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07127e9a-327f-4627-9744-2e61fd8ca597 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-07127e9a-327f-4627-9744-2e61fd8ca597 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:00.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:00.450985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:00.451895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:00.451895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:00.451895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:00.451895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:00.451895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:00.451895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:00.451895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:00.451895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:00.454309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 312/627] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:00.460142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07127e9a-327f-4627-9744-2e61fd8ca597 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:00.522734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606fe35-c981-4480-a309-a4434b74c9f1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:00.524460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:00.580022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2a346-be8d-4e8a-808d-dbd1f1dce769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:00.580647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2a346-be8d-4e8a-808d-dbd1f1dce769 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.580925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2a346-be8d-4e8a-808d-dbd1f1dce769 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.581193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2a346-be8d-4e8a-808d-dbd1f1dce769 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.581936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2a346-be8d-4e8a-808d-dbd1f1dce769 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:00.582239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2a346-be8d-4e8a-808d-dbd1f1dce769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:00.583702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2a346-be8d-4e8a-808d-dbd1f1dce769 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:00.621065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 316/628] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Sep 3 01:10:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:00.627192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2a346-be8d-4e8a-808d-dbd1f1dce769 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:00.681493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07127e9a-327f-4627-9744-2e61fd8ca597 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:00.720942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2aa11-52fa-48a0-a6ab-79402e77492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:00.721546 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2aa11-52fa-48a0-a6ab-79402e77492e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.721823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2aa11-52fa-48a0-a6ab-79402e77492e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.722094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2aa11-52fa-48a0-a6ab-79402e77492e None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.722783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2aa11-52fa-48a0-a6ab-79402e77492e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:00.723083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2aa11-52fa-48a0-a6ab-79402e77492e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:00.724579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2aa11-52fa-48a0-a6ab-79402e77492e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:00.736216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 313/629] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:00.736806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2aa11-52fa-48a0-a6ab-79402e77492e None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:00.742181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:00.748473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2a346-be8d-4e8a-808d-dbd1f1dce769 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:00.781394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3644-44a4-479e-b22f-1e4ce8e05403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:00.782152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3644-44a4-479e-b22f-1e4ce8e05403 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.782427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3644-44a4-479e-b22f-1e4ce8e05403 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.782696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3644-44a4-479e-b22f-1e4ce8e05403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.825940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:00.835692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2aa11-52fa-48a0-a6ab-79402e77492e None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:00.848572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae3644-44a4-479e-b22f-1e4ce8e05403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:00.850370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae3644-44a4-479e-b22f-1e4ce8e05403 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:00.868444 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb3a19-3423-4582-87e3-edac1a2fd8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:00.869067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3a19-3423-4582-87e3-edac1a2fd8bd None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.869348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3a19-3423-4582-87e3-edac1a2fd8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.869620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3a19-3423-4582-87e3-edac1a2fd8bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.879969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb3a19-3423-4582-87e3-edac1a2fd8bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-46fb3a19-3423-4582-87e3-edac1a2fd8bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:00.885157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:00.886144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:00.886958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 314/630] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:10:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:00.887707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9138-eef8-48a1-adc6-861846699c7a None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.888037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9138-eef8-48a1-adc6-861846699c7a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.888246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9138-eef8-48a1-adc6-861846699c7a None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.889620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 315/631] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:00.890465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ffe0b-5e55-43de-a446-2ffe5bb484a3 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:00.891803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ffe0b-5e55-43de-a446-2ffe5bb484a3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:00.891803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ffe0b-5e55-43de-a446-2ffe5bb484a3 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:00.892289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 316/632] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:00.894529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ffe0b-5e55-43de-a446-2ffe5bb484a3 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:00.944029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:00.951071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 317/633] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:10:00.951915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3644-44a4-479e-b22f-1e4ce8e05403 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:00.995276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ffe0b-5e55-43de-a446-2ffe5bb484a3 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:01.027550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1366-191b-4358-801f-6df15aab7fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:01.028203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1366-191b-4358-801f-6df15aab7fc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.028477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1366-191b-4358-801f-6df15aab7fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.028746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1366-191b-4358-801f-6df15aab7fc1 None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/4a844df7e3574911b6ea31e7d7bee715/roles/76b5fcb0eb664fb2b2812e427e7f9390` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.042376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1366-191b-4358-801f-6df15aab7fc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=4a844df7e3574911b6ea31e7d7bee715, role_id=76b5fcb0eb664fb2b2812e427e7f9390)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:01.043899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1366-191b-4358-801f-6df15aab7fc1 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:01.048133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3644-44a4-479e-b22f-1e4ce8e05403 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:01.056752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 317/634] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:10:00 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/4a844df7e3574911b6ea31e7d7bee715/roles/76b5fcb0eb664fb2b2812e427e7f9390 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:10:01.063936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a73a3-e3ea-46b4-a084-be63d399160c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.063936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a73a3-e3ea-46b4-a084-be63d399160c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.063936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a73a3-e3ea-46b4-a084-be63d399160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.064897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:01.083234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2a1a73a3-e3ea-46b4-a084-be63d399160c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:01.084554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2a1a73a3-e3ea-46b4-a084-be63d399160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:01.092466 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b430bf8-b12a-498f-88c3-8edb2137c375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:01.093448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430bf8-b12a-498f-88c3-8edb2137c375 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.093705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430bf8-b12a-498f-88c3-8edb2137c375 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.093961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430bf8-b12a-498f-88c3-8edb2137c375 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.094714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b430bf8-b12a-498f-88c3-8edb2137c375 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:01.095007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b430bf8-b12a-498f-88c3-8edb2137c375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:01.096467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b430bf8-b12a-498f-88c3-8edb2137c375 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:01.107481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 318/635] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:10:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:01.108824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09ff13-08dd-445a-87e8-e3d541bff648 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.109107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09ff13-08dd-445a-87e8-e3d541bff648 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.109375 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09ff13-08dd-445a-87e8-e3d541bff648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.133025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9c09ff13-08dd-445a-87e8-e3d541bff648 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:01.134889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9c09ff13-08dd-445a-87e8-e3d541bff648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:01.163544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 318/636] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:01.164441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a73a3-e3ea-46b4-a084-be63d399160c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:01.211644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:01.233283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 319/637] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:01.233283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09ff13-08dd-445a-87e8-e3d541bff648 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:01.297507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a73a3-e3ea-46b4-a084-be63d399160c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:01.328079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:01.334335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee13a1-a6a8-41f8-a79e-21acc9238b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:01.334976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee13a1-a6a8-41f8-a79e-21acc9238b10 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.335270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee13a1-a6a8-41f8-a79e-21acc9238b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.335594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee13a1-a6a8-41f8-a79e-21acc9238b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.346109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee13a1-a6a8-41f8-a79e-21acc9238b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:01.347650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee13a1-a6a8-41f8-a79e-21acc9238b10 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:01.353598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09ff13-08dd-445a-87e8-e3d541bff648 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-86ee13a1-a6a8-41f8-a79e-21acc9238b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:01.363890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:01.364839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:01.365734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:01.365734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:01.365734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:01.367970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 319/638] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:01.376401 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee13a1-a6a8-41f8-a79e-21acc9238b10 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:01.402356 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d712b-109e-4940-b0d2-0cdf91fcad7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:01.403468 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d712b-109e-4940-b0d2-0cdf91fcad7d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.403963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d712b-109e-4940-b0d2-0cdf91fcad7d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.404489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d712b-109e-4940-b0d2-0cdf91fcad7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.415343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d712b-109e-4940-b0d2-0cdf91fcad7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:01.417160 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d712b-109e-4940-b0d2-0cdf91fcad7d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-919d712b-109e-4940-b0d2-0cdf91fcad7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:01.433138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:01.434221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:01.435102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:01.435102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:01.435102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:01.437271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 320/639] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:01.443302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d712b-109e-4940-b0d2-0cdf91fcad7d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:01.490290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:01.553776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee13a1-a6a8-41f8-a79e-21acc9238b10 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:01.567844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d712b-109e-4940-b0d2-0cdf91fcad7d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:01.598623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb7cd-a88c-4d40-8ec1-0c3d3f6409ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:01.599231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb7cd-a88c-4d40-8ec1-0c3d3f6409ec None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.599553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb7cd-a88c-4d40-8ec1-0c3d3f6409ec None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.599822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb7cd-a88c-4d40-8ec1-0c3d3f6409ec None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.600471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb7cd-a88c-4d40-8ec1-0c3d3f6409ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:01.600769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb7cd-a88c-4d40-8ec1-0c3d3f6409ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:01.602406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb7cd-a88c-4d40-8ec1-0c3d3f6409ec None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:01.604122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2464d2-1c70-4194-87a4-d6c3116c524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:01.604737 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2464d2-1c70-4194-87a4-d6c3116c524f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.605015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2464d2-1c70-4194-87a4-d6c3116c524f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.605284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2464d2-1c70-4194-87a4-d6c3116c524f None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.606274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2464d2-1c70-4194-87a4-d6c3116c524f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:01.606570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2464d2-1c70-4194-87a4-d6c3116c524f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:01.607961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2464d2-1c70-4194-87a4-d6c3116c524f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:01.617036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 320/640] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:01.618138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb7cd-a88c-4d40-8ec1-0c3d3f6409ec None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:01.628907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 321/641] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:01.630415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2464d2-1c70-4194-87a4-d6c3116c524f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:01.665311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:01.721113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb7cd-a88c-4d40-8ec1-0c3d3f6409ec None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:01.739191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:01.742502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2464d2-1c70-4194-87a4-d6c3116c524f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:01.762936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff56bfa-ffc4-4c89-972e-4540522bb074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:01.763611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56bfa-ffc4-4c89-972e-4540522bb074 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.763893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56bfa-ffc4-4c89-972e-4540522bb074 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.764168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56bfa-ffc4-4c89-972e-4540522bb074 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.774721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff56bfa-ffc4-4c89-972e-4540522bb074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-6ff56bfa-ffc4-4c89-972e-4540522bb074 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:01.779539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:01.780455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:01.781306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 321/642] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:10:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:01.782404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff56bfa-ffc4-4c89-972e-4540522bb074 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:01.786555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b581dc4-2e5c-46b7-997e-fae22751dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:01.787213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b581dc4-2e5c-46b7-997e-fae22751dff8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.787512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b581dc4-2e5c-46b7-997e-fae22751dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.787778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b581dc4-2e5c-46b7-997e-fae22751dff8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.799081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b581dc4-2e5c-46b7-997e-fae22751dff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4b581dc4-2e5c-46b7-997e-fae22751dff8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:01.803894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:01.804880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:01.805734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 322/643] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:10:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:01.807631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b581dc4-2e5c-46b7-997e-fae22751dff8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:01.892513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff56bfa-ffc4-4c89-972e-4540522bb074 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:01.894833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:01.909604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b581dc4-2e5c-46b7-997e-fae22751dff8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:01.932195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1afb63-907b-427a-baa9-2baab598829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:01.932821 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1afb63-907b-427a-baa9-2baab598829e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.933098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1afb63-907b-427a-baa9-2baab598829e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.933378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1afb63-907b-427a-baa9-2baab598829e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.940246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1afb63-907b-427a-baa9-2baab598829e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:01.941701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1afb63-907b-427a-baa9-2baab598829e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:01.944772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e3cb0-25f5-445f-afd4-f42f6d82a4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:01.945399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e3cb0-25f5-445f-afd4-f42f6d82a4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:01.945675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e3cb0-25f5-445f-afd4-f42f6d82a4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:01.945942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e3cb0-25f5-445f-afd4-f42f6d82a4f1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:01.953172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e3cb0-25f5-445f-afd4-f42f6d82a4f1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:01.954833 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e3cb0-25f5-445f-afd4-f42f6d82a4f1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-ea1afb63-907b-427a-baa9-2baab598829e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:01.955302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:01.956171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:01.957238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:01.957238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:01.957238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:01.957238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:01.957238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:01.957238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:01.957238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:01.957238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:01.957238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 322/644] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:01.957238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1afb63-907b-427a-baa9-2baab598829e None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7f6e3cb0-25f5-445f-afd4-f42f6d82a4f1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:01.975371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:01.976345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:01.977260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 323/645] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:01.977861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e3cb0-25f5-445f-afd4-f42f6d82a4f1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:02.008789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:02.072808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1afb63-907b-427a-baa9-2baab598829e None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:02.091295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e3cb0-25f5-445f-afd4-f42f6d82a4f1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:02.107273 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4b772-c61d-439b-a138-edc19420132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:02.107891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4b772-c61d-439b-a138-edc19420132b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:02.108171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4b772-c61d-439b-a138-edc19420132b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:02.108441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4b772-c61d-439b-a138-edc19420132b None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:02.109109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4b772-c61d-439b-a138-edc19420132b None admin] RBAC: Adding query filter params (name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:02.109412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4b772-c61d-439b-a138-edc19420132b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:02.111463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4b772-c61d-439b-a138-edc19420132b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:02.120654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 323/646] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:10:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:02.121482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4b772-c61d-439b-a138-edc19420132b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:02.134729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0e2a-23b0-46d2-9059-e3cfaf2aa1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:02.135378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0e2a-23b0-46d2-9059-e3cfaf2aa1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:02.135655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0e2a-23b0-46d2-9059-e3cfaf2aa1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:02.136104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0e2a-23b0-46d2-9059-e3cfaf2aa1c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:02.136590 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d0e2a-23b0-46d2-9059-e3cfaf2aa1c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:02.136895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d0e2a-23b0-46d2-9059-e3cfaf2aa1c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:02.138262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d0e2a-23b0-46d2-9059-e3cfaf2aa1c8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:02.151449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 324/647] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:10:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:02.151449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0e2a-23b0-46d2-9059-e3cfaf2aa1c8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:02.156469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:02.240014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4b772-c61d-439b-a138-edc19420132b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:02.245504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:02.265320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0e2a-23b0-46d2-9059-e3cfaf2aa1c8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:02.278651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e2221-0797-447e-9ab1-c6b04e348c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:02.279221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e2221-0797-447e-9ab1-c6b04e348c3b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:02.279529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e2221-0797-447e-9ab1-c6b04e348c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:02.280035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e2221-0797-447e-9ab1-c6b04e348c3b None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:02.280488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e2221-0797-447e-9ab1-c6b04e348c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:02.280794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e2221-0797-447e-9ab1-c6b04e348c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:02.282810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e2221-0797-447e-9ab1-c6b04e348c3b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:02.300324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 324/648] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:02.300324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e2221-0797-447e-9ab1-c6b04e348c3b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:02.306235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76253581-9246-47d3-b23e-51194fb2b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:02.306858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76253581-9246-47d3-b23e-51194fb2b63e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:02.307546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76253581-9246-47d3-b23e-51194fb2b63e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:02.307828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76253581-9246-47d3-b23e-51194fb2b63e None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:02.308874 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76253581-9246-47d3-b23e-51194fb2b63e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:02.309187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76253581-9246-47d3-b23e-51194fb2b63e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:02.310774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76253581-9246-47d3-b23e-51194fb2b63e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:02.328698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 325/649] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Sep 3 01:10:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:02.329489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76253581-9246-47d3-b23e-51194fb2b63e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:02.394622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:02.410917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e2221-0797-447e-9ab1-c6b04e348c3b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:02.432967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76253581-9246-47d3-b23e-51194fb2b63e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:02.449596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3f221-fce0-4314-bef6-d20db86918cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:02.450238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3f221-fce0-4314-bef6-d20db86918cb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:02.450508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3f221-fce0-4314-bef6-d20db86918cb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:02.450783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3f221-fce0-4314-bef6-d20db86918cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:02.461298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3f221-fce0-4314-bef6-d20db86918cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:02.462732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3f221-fce0-4314-bef6-d20db86918cb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:02.469480 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6caf6-0d12-4562-91ae-95697e66f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:02.470295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6caf6-0d12-4562-91ae-95697e66f68f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:02.470577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6caf6-0d12-4562-91ae-95697e66f68f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:02.470846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6caf6-0d12-4562-91ae-95697e66f68f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-a2c3f221-fce0-4314-bef6-d20db86918cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:02.477784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:02.478716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:02.479622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:02.479622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:02.479622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:02.479622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 325/650] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:02.479874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3f221-fce0-4314-bef6-d20db86918cb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:02.482875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:02.486991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6caf6-0d12-4562-91ae-95697e66f68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:02.488553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6caf6-0d12-4562-91ae-95697e66f68f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-94d6caf6-0d12-4562-91ae-95697e66f68f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:02.504670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:02.505668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:02.506551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:02.506551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:02.506551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:02.506551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 326/651] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:02.506551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6caf6-0d12-4562-91ae-95697e66f68f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:02.599814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3f221-fce0-4314-bef6-d20db86918cb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:02.615700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6caf6-0d12-4562-91ae-95697e66f68f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:02.640476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353428b3-5416-4d2e-854a-cf511d671fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:02.641208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353428b3-5416-4d2e-854a-cf511d671fbf None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:02.641555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353428b3-5416-4d2e-854a-cf511d671fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:02.641758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353428b3-5416-4d2e-854a-cf511d671fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:02.642490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353428b3-5416-4d2e-854a-cf511d671fbf None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=9c4076fd5abc4b508a0215ce22af85d6) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:02.642796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353428b3-5416-4d2e-854a-cf511d671fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:02.644432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353428b3-5416-4d2e-854a-cf511d671fbf None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:02.650048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f6a6d-6d3f-435f-8762-28bb9d774fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:02.650777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f6a6d-6d3f-435f-8762-28bb9d774fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:02.651061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f6a6d-6d3f-435f-8762-28bb9d774fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:02.651368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f6a6d-6d3f-435f-8762-28bb9d774fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:02.663282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 326/652] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:02 2022] GET /identity/v3/role_assignments?user.id=9c4076fd5abc4b508a0215ce22af85d6&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:02.663282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353428b3-5416-4d2e-854a-cf511d671fbf None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:02.666619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:02.736082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:02.749555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f6a6d-6d3f-435f-8762-28bb9d774fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:02.751417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f6a6d-6d3f-435f-8762-28bb9d774fc5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:02.782903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353428b3-5416-4d2e-854a-cf511d671fbf None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:02.822770 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a408ac-4855-4563-94da-d4b93ddba75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:02.824084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a408ac-4855-4563-94da-d4b93ddba75a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:02.824373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a408ac-4855-4563-94da-d4b93ddba75a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:02.826060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a408ac-4855-4563-94da-d4b93ddba75a None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:02.826060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a408ac-4855-4563-94da-d4b93ddba75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:02.826060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a408ac-4855-4563-94da-d4b93ddba75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:02.828173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a408ac-4855-4563-94da-d4b93ddba75a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:02.843636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 327/653] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:02.843956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a408ac-4855-4563-94da-d4b93ddba75a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:02.880623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 327/654] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:10:02.881485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f6a6d-6d3f-435f-8762-28bb9d774fc5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:02.920505 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:02.975987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a408ac-4855-4563-94da-d4b93ddba75a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.006677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:03.018529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb4f69-5fe2-4ca7-aaaf-23cabff9d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:03.019149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb4f69-5fe2-4ca7-aaaf-23cabff9d58f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.019475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb4f69-5fe2-4ca7-aaaf-23cabff9d58f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.019753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb4f69-5fe2-4ca7-aaaf-23cabff9d58f None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.020270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f6a6d-6d3f-435f-8762-28bb9d774fc5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.020424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb4f69-5fe2-4ca7-aaaf-23cabff9d58f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:03.020707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb4f69-5fe2-4ca7-aaaf-23cabff9d58f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:03.022107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb4f69-5fe2-4ca7-aaaf-23cabff9d58f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:03.038221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 328/655] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:03.043772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb4f69-5fe2-4ca7-aaaf-23cabff9d58f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:03.062344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d4073-0c3d-4fd9-8743-8f9dccbb9ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:03.063413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d4073-0c3d-4fd9-8743-8f9dccbb9ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.063888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d4073-0c3d-4fd9-8743-8f9dccbb9ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.064418 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d4073-0c3d-4fd9-8743-8f9dccbb9ad0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.072243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d4073-0c3d-4fd9-8743-8f9dccbb9ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:03.074030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d4073-0c3d-4fd9-8743-8f9dccbb9ad0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a24d4073-0c3d-4fd9-8743-8f9dccbb9ad0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:03.086425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:03.087454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:03.088423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 328/656] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:03.089007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d4073-0c3d-4fd9-8743-8f9dccbb9ad0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:03.157136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb4f69-5fe2-4ca7-aaaf-23cabff9d58f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.181582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:03.193169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a89fe-7121-466c-a18c-93dd5d014076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:03.193811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a89fe-7121-466c-a18c-93dd5d014076 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.194092 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a89fe-7121-466c-a18c-93dd5d014076 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.194367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a89fe-7121-466c-a18c-93dd5d014076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.202693 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d4073-0c3d-4fd9-8743-8f9dccbb9ad0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.205500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a89fe-7121-466c-a18c-93dd5d014076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:03.206986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a89fe-7121-466c-a18c-93dd5d014076 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-153a89fe-7121-466c-a18c-93dd5d014076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:03.222452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:03.223506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:03.224391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:03.224391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:03.224391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:03.228660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 329/657] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:03.229544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929661d0-0fee-481d-a441-ec6163b45867 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.229838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929661d0-0fee-481d-a441-ec6163b45867 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.230113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929661d0-0fee-481d-a441-ec6163b45867 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.231933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 330/658] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:03.232569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929661d0-0fee-481d-a441-ec6163b45867 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:03.240672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49187d6c-3a19-471c-9b5f-86de8f1ba3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:03.241313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187d6c-3a19-471c-9b5f-86de8f1ba3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.241594 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187d6c-3a19-471c-9b5f-86de8f1ba3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.241866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187d6c-3a19-471c-9b5f-86de8f1ba3a7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.250850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49187d6c-3a19-471c-9b5f-86de8f1ba3a7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:03.252366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49187d6c-3a19-471c-9b5f-86de8f1ba3a7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-49187d6c-3a19-471c-9b5f-86de8f1ba3a7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:03.263901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:03.264840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:03.265766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:03.265766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:03.265766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:03.265766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:03.265766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:03.265766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:03.265766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:03.265766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:03.265766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 01:10:03.265766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:03.266659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 329/659] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:10:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:03.267393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49187d6c-3a19-471c-9b5f-86de8f1ba3a7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:03.283868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:03.346872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929661d0-0fee-481d-a441-ec6163b45867 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.372600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49187d6c-3a19-471c-9b5f-86de8f1ba3a7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.380960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b6429-5bae-4cf5-b368-bea1349245ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:03.381577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b6429-5bae-4cf5-b368-bea1349245ee None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.381863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b6429-5bae-4cf5-b368-bea1349245ee None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.382139 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b6429-5bae-4cf5-b368-bea1349245ee None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.382864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b6429-5bae-4cf5-b368-bea1349245ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:03.383173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b6429-5bae-4cf5-b368-bea1349245ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:03.384650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b6429-5bae-4cf5-b368-bea1349245ee None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:03.402903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 331/660] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Sep 3 01:10:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:03.404113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298731-5e44-4631-90ca-4f8b033f35d7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.404401 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298731-5e44-4631-90ca-4f8b033f35d7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.404676 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298731-5e44-4631-90ca-4f8b033f35d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.408580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c81e6f-d90f-45b4-ae1c-21a7c31bc31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:03.409310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c81e6f-d90f-45b4-ae1c-21a7c31bc31c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.409589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c81e6f-d90f-45b4-ae1c-21a7c31bc31c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.409950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c81e6f-d90f-45b4-ae1c-21a7c31bc31c None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.410599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c81e6f-d90f-45b4-ae1c-21a7c31bc31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:03.410899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c81e6f-d90f-45b4-ae1c-21a7c31bc31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:03.412821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c81e6f-d90f-45b4-ae1c-21a7c31bc31c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:03.423784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-9d298731-5e44-4631-90ca-4f8b033f35d7 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:03.424983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9d298731-5e44-4631-90ca-4f8b033f35d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:03.428643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 330/661] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:03.429840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c81e6f-d90f-45b4-ae1c-21a7c31bc31c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:03.453396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:03.498588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 332/662] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:03.504197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:03.508171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298731-5e44-4631-90ca-4f8b033f35d7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:03.534565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c81e6f-d90f-45b4-ae1c-21a7c31bc31c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.570405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea22594-1cc1-4666-b3c3-613a683c78c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:03.571123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea22594-1cc1-4666-b3c3-613a683c78c5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.571431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea22594-1cc1-4666-b3c3-613a683c78c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.571701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea22594-1cc1-4666-b3c3-613a683c78c5 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.572429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea22594-1cc1-4666-b3c3-613a683c78c5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:03.572790 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea22594-1cc1-4666-b3c3-613a683c78c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:03.580560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea22594-1cc1-4666-b3c3-613a683c78c5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:03.598990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 331/663] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Sep 3 01:10:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:03.599809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea22594-1cc1-4666-b3c3-613a683c78c5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:03.642722 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298731-5e44-4631-90ca-4f8b033f35d7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.682159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7590c54-0646-4627-a988-37a420da88f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:03.682686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7590c54-0646-4627-a988-37a420da88f0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.682961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7590c54-0646-4627-a988-37a420da88f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.683229 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7590c54-0646-4627-a988-37a420da88f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.715453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:03.720546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea22594-1cc1-4666-b3c3-613a683c78c5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.752044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:03.760689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf39baa-5617-40db-b0fd-95f16e353bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:03.761327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf39baa-5617-40db-b0fd-95f16e353bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.761599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf39baa-5617-40db-b0fd-95f16e353bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.761863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf39baa-5617-40db-b0fd-95f16e353bd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.767729 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7590c54-0646-4627-a988-37a420da88f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:03.769279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf39baa-5617-40db-b0fd-95f16e353bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:03.769815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7590c54-0646-4627-a988-37a420da88f0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:03.770741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf39baa-5617-40db-b0fd-95f16e353bd3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4bf39baa-5617-40db-b0fd-95f16e353bd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:03.782600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:03.783650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:03.784559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:03.784559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:03.784559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:03.784559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:03.784559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:03.784559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:03.784559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:03.784559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:03.788294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 332/664] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:03.789156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf39baa-5617-40db-b0fd-95f16e353bd3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:03.876927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 333/665] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:10:03.877905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7590c54-0646-4627-a988-37a420da88f0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:03.895132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf39baa-5617-40db-b0fd-95f16e353bd3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.929092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4e6d0-15bb-4361-bbea-755826f4367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:03.930063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4e6d0-15bb-4361-bbea-755826f4367c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:03.930333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4e6d0-15bb-4361-bbea-755826f4367c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:03.930616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4e6d0-15bb-4361-bbea-755826f4367c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:03.944382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:03.985995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7590c54-0646-4627-a988-37a420da88f0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:03.988855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:03.999871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4e6d0-15bb-4361-bbea-755826f4367c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:04.001922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4e6d0-15bb-4361-bbea-755826f4367c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:04.019838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09d119-a8dd-4113-9f68-d5b2f91af4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:04.020473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09d119-a8dd-4113-9f68-d5b2f91af4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.020752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09d119-a8dd-4113-9f68-d5b2f91af4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.021030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09d119-a8dd-4113-9f68-d5b2f91af4e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.031879 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09d119-a8dd-4113-9f68-d5b2f91af4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-dc09d119-a8dd-4113-9f68-d5b2f91af4e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:04.037242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:04.038176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:04.039030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 334/666] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:10:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:04.039751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09d119-a8dd-4113-9f68-d5b2f91af4e8 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.107563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 333/667] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:10:04.108762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4e6d0-15bb-4361-bbea-755826f4367c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.150929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09d119-a8dd-4113-9f68-d5b2f91af4e8 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:04.181755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:04.196584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0f1bf-9b23-4559-a146-ae75a6ffba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:04.197135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0f1bf-9b23-4559-a146-ae75a6ffba12 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.197407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0f1bf-9b23-4559-a146-ae75a6ffba12 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.197674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0f1bf-9b23-4559-a146-ae75a6ffba12 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.198369 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0f1bf-9b23-4559-a146-ae75a6ffba12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:04.198664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0f1bf-9b23-4559-a146-ae75a6ffba12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:04.200129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0f1bf-9b23-4559-a146-ae75a6ffba12 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:04.206982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:04.217062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 335/668] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:04.217062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0f1bf-9b23-4559-a146-ae75a6ffba12 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.222964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4e6d0-15bb-4361-bbea-755826f4367c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:04.260773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8423da-594d-4e00-bd1d-5dd1e4d7d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:04.261465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8423da-594d-4e00-bd1d-5dd1e4d7d1af None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.261742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8423da-594d-4e00-bd1d-5dd1e4d7d1af None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.262011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8423da-594d-4e00-bd1d-5dd1e4d7d1af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.273263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8423da-594d-4e00-bd1d-5dd1e4d7d1af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:04.274966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8423da-594d-4e00-bd1d-5dd1e4d7d1af None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9d8423da-594d-4e00-bd1d-5dd1e4d7d1af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:04.289820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:04.290847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:04.292451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:04.292451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:04.292451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:04.292451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 334/669] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:04.292451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8423da-594d-4e00-bd1d-5dd1e4d7d1af None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.323834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0f1bf-9b23-4559-a146-ae75a6ffba12 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:04.365941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461b646-4d84-4da0-b473-0b421eb47466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:04.366936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461b646-4d84-4da0-b473-0b421eb47466 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.367220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461b646-4d84-4da0-b473-0b421eb47466 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.367525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461b646-4d84-4da0-b473-0b421eb47466 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.368200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461b646-4d84-4da0-b473-0b421eb47466 None admin] RBAC: Adding query filter params (name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:04.368504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461b646-4d84-4da0-b473-0b421eb47466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:04.369878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461b646-4d84-4da0-b473-0b421eb47466 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:04.378487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 336/670] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:04.379324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461b646-4d84-4da0-b473-0b421eb47466 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.400118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8423da-594d-4e00-bd1d-5dd1e4d7d1af None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:04.427122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:04.439935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47237f0a-6aa9-42db-baf6-5886bad4b96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:04.440584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47237f0a-6aa9-42db-baf6-5886bad4b96c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.440871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47237f0a-6aa9-42db-baf6-5886bad4b96c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.441101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47237f0a-6aa9-42db-baf6-5886bad4b96c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.455706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47237f0a-6aa9-42db-baf6-5886bad4b96c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:04.457078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47237f0a-6aa9-42db-baf6-5886bad4b96c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:04.459000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-47237f0a-6aa9-42db-baf6-5886bad4b96c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:04.474768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:04.475884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:04.482127 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:04.482127 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:04.482127 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:04.482127 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 335/671] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:04.482127 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47237f0a-6aa9-42db-baf6-5886bad4b96c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.486790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461b646-4d84-4da0-b473-0b421eb47466 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:04.527780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e92ded-b4e2-4974-abf7-c7e3afce5d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:04.528664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92ded-b4e2-4974-abf7-c7e3afce5d77 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.528950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92ded-b4e2-4974-abf7-c7e3afce5d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.529220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92ded-b4e2-4974-abf7-c7e3afce5d77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.530108 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e92ded-b4e2-4974-abf7-c7e3afce5d77 None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=248ccaa14fce4726826a16c4d3e6ca54) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:04.530752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e92ded-b4e2-4974-abf7-c7e3afce5d77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:04.532340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e92ded-b4e2-4974-abf7-c7e3afce5d77 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:04.546952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 337/672] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/role_assignments?user.id=248ccaa14fce4726826a16c4d3e6ca54&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:04.546952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e92ded-b4e2-4974-abf7-c7e3afce5d77 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.594583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47237f0a-6aa9-42db-baf6-5886bad4b96c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:04.645244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc335d-788b-4e84-8ced-7077dcb976a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:04.645897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc335d-788b-4e84-8ced-7077dcb976a2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.646582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc335d-788b-4e84-8ced-7077dcb976a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.646854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc335d-788b-4e84-8ced-7077dcb976a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.647837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc335d-788b-4e84-8ced-7077dcb976a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:04.648197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc335d-788b-4e84-8ced-7077dcb976a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:04.649951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc335d-788b-4e84-8ced-7077dcb976a2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:04.671432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 336/673] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:04.672432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc335d-788b-4e84-8ced-7077dcb976a2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.679629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e92ded-b4e2-4974-abf7-c7e3afce5d77 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:04.692853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:04.727222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45270ec3-8889-4fbc-9432-d6fcec9fbdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:04.728136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45270ec3-8889-4fbc-9432-d6fcec9fbdcf None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.728570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45270ec3-8889-4fbc-9432-d6fcec9fbdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.728842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45270ec3-8889-4fbc-9432-d6fcec9fbdcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.740875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:04.741198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45270ec3-8889-4fbc-9432-d6fcec9fbdcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:04.742715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45270ec3-8889-4fbc-9432-d6fcec9fbdcf None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-45270ec3-8889-4fbc-9432-d6fcec9fbdcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:04.759134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:04.760208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:04.761085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:04.761085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:04.761085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:04.761085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 338/674] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:04.761395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45270ec3-8889-4fbc-9432-d6fcec9fbdcf None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.786808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc335d-788b-4e84-8ced-7077dcb976a2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:04.820626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f0ef9-692a-47df-989c-ad7d1576966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:04.821328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f0ef9-692a-47df-989c-ad7d1576966c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.821610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f0ef9-692a-47df-989c-ad7d1576966c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.821881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f0ef9-692a-47df-989c-ad7d1576966c None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.822524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f0ef9-692a-47df-989c-ad7d1576966c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:04.822823 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f0ef9-692a-47df-989c-ad7d1576966c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:04.824226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f0ef9-692a-47df-989c-ad7d1576966c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:04.835684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 337/675] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:04.840613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83331600-b9ce-42cf-8330-e45c7fd88f23 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.840897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83331600-b9ce-42cf-8330-e45c7fd88f23 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.841173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83331600-b9ce-42cf-8330-e45c7fd88f23 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.842448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 338/676] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:04.843143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83331600-b9ce-42cf-8330-e45c7fd88f23 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.873925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45270ec3-8889-4fbc-9432-d6fcec9fbdcf None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:04.908096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9567dcf-ae37-4de8-9890-dfcadc4e7719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:04.908735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567dcf-ae37-4de8-9890-dfcadc4e7719 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:04.909016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567dcf-ae37-4de8-9890-dfcadc4e7719 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:04.909290 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567dcf-ae37-4de8-9890-dfcadc4e7719 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:04.915954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9567dcf-ae37-4de8-9890-dfcadc4e7719 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:04.917421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9567dcf-ae37-4de8-9890-dfcadc4e7719 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-e9567dcf-ae37-4de8-9890-dfcadc4e7719 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:04.928606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:04.929524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:04.935346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:04.935346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:04.935346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:04.935346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:04.935346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:04.935346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:04.935346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:04.935346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:04.935346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 339/677] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:04.935346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9567dcf-ae37-4de8-9890-dfcadc4e7719 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:04.956170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:04.966443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83331600-b9ce-42cf-8330-e45c7fd88f23 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:04.987567 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:05.009460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce82186-9a80-40ef-8ba3-1b97ea7e9ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:05.010552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce82186-9a80-40ef-8ba3-1b97ea7e9ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.010837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce82186-9a80-40ef-8ba3-1b97ea7e9ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.011106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce82186-9a80-40ef-8ba3-1b97ea7e9ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.011780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce82186-9a80-40ef-8ba3-1b97ea7e9ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:05.012232 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce82186-9a80-40ef-8ba3-1b97ea7e9ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:05.013588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce82186-9a80-40ef-8ba3-1b97ea7e9ee0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:05.026206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 339/678] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:05.027296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dd79e-06c2-4383-b794-2fb88b20f79b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.027580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dd79e-06c2-4383-b794-2fb88b20f79b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.027844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dd79e-06c2-4383-b794-2fb88b20f79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.046563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fb8dd79e-06c2-4383-b794-2fb88b20f79b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:05.047801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fb8dd79e-06c2-4383-b794-2fb88b20f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:05.053684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9567dcf-ae37-4de8-9890-dfcadc4e7719 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:05.090064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc174c-f644-46a1-b384-b36b56966943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:05.090706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc174c-f644-46a1-b384-b36b56966943 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.091001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc174c-f644-46a1-b384-b36b56966943 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.091288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc174c-f644-46a1-b384-b36b56966943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.098782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc174c-f644-46a1-b384-b36b56966943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:05.100284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc174c-f644-46a1-b384-b36b56966943 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-0abc174c-f644-46a1-b384-b36b56966943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:05.112388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:05.113342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:05.114237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:05.114237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:05.114237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:05.114237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:05.114237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:05.114237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:05.114237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:05.114237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:05.114237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 340/679] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:05.114737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc174c-f644-46a1-b384-b36b56966943 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:05.127297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 340/680] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:05.127297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dd79e-06c2-4383-b794-2fb88b20f79b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:05.220198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:05.242663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc174c-f644-46a1-b384-b36b56966943 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:05.256818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dd79e-06c2-4383-b794-2fb88b20f79b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:05.260161 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:05.284569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec28ef-1d59-41e2-8679-c9e78af44533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:05.285545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec28ef-1d59-41e2-8679-c9e78af44533 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.286015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec28ef-1d59-41e2-8679-c9e78af44533 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.286633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec28ef-1d59-41e2-8679-c9e78af44533 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.287657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec28ef-1d59-41e2-8679-c9e78af44533 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:05.288150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec28ef-1d59-41e2-8679-c9e78af44533 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:05.289898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec28ef-1d59-41e2-8679-c9e78af44533 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:05.307322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e1348-b6b7-4dc2-b9b3-a0ca358699ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:05.307322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e1348-b6b7-4dc2-b9b3-a0ca358699ad None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.307322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e1348-b6b7-4dc2-b9b3-a0ca358699ad None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.307322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e1348-b6b7-4dc2-b9b3-a0ca358699ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.308153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 341/681] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:05.309302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec28ef-1d59-41e2-8679-c9e78af44533 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:05.316580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e1348-b6b7-4dc2-b9b3-a0ca358699ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:05.318014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e1348-b6b7-4dc2-b9b3-a0ca358699ad None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-737e1348-b6b7-4dc2-b9b3-a0ca358699ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:05.333157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:05.334106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:05.335047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 341/682] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:05.335676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e1348-b6b7-4dc2-b9b3-a0ca358699ad None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:05.426128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec28ef-1d59-41e2-8679-c9e78af44533 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:05.452724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e1348-b6b7-4dc2-b9b3-a0ca358699ad None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:05.462488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff1166-330d-4eaf-9325-b70883cd0412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:05.463105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff1166-330d-4eaf-9325-b70883cd0412 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.463719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff1166-330d-4eaf-9325-b70883cd0412 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.463719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff1166-330d-4eaf-9325-b70883cd0412 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.464397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff1166-330d-4eaf-9325-b70883cd0412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:05.464705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff1166-330d-4eaf-9325-b70883cd0412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:05.466156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff1166-330d-4eaf-9325-b70883cd0412 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:05.475343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:05.483582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 342/683] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:05.483582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff1166-330d-4eaf-9325-b70883cd0412 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:05.500608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef6131-840a-4a4b-a2ae-cff14975a613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:05.501398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef6131-840a-4a4b-a2ae-cff14975a613 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.501690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef6131-840a-4a4b-a2ae-cff14975a613 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.501933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef6131-840a-4a4b-a2ae-cff14975a613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.502908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef6131-840a-4a4b-a2ae-cff14975a613 None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=54131719962e4463b0b874916cb40973) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:05.503610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef6131-840a-4a4b-a2ae-cff14975a613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:05.505036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef6131-840a-4a4b-a2ae-cff14975a613 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:05.523646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 342/684] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:05 2022] GET /identity/v3/role_assignments?user.id=54131719962e4463b0b874916cb40973&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:05.523646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef6131-840a-4a4b-a2ae-cff14975a613 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:05.558715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:05.628184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff1166-330d-4eaf-9325-b70883cd0412 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:05.651263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef6131-840a-4a4b-a2ae-cff14975a613 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:05.671480 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ebabc-e9ad-4012-9666-dfaeced2e6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:05.673041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebabc-e9ad-4012-9666-dfaeced2e6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.673810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebabc-e9ad-4012-9666-dfaeced2e6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.674715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebabc-e9ad-4012-9666-dfaeced2e6a4 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.676442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ebabc-e9ad-4012-9666-dfaeced2e6a4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:05.677231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ebabc-e9ad-4012-9666-dfaeced2e6a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:05.679544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ebabc-e9ad-4012-9666-dfaeced2e6a4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:05.692108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857acc-e3a2-4a1f-a29d-b269e0dc8538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:05.692802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857acc-e3a2-4a1f-a29d-b269e0dc8538 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.693085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857acc-e3a2-4a1f-a29d-b269e0dc8538 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.693357 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857acc-e3a2-4a1f-a29d-b269e0dc8538 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.701291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 343/685] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Sep 3 01:10:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:05.702816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ebabc-e9ad-4012-9666-dfaeced2e6a4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:05.706233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03857acc-e3a2-4a1f-a29d-b269e0dc8538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-03857acc-e3a2-4a1f-a29d-b269e0dc8538 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:05.712017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:05.713049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:05.714381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 343/686] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:05.715138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857acc-e3a2-4a1f-a29d-b269e0dc8538 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:05.769234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:05.822141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ebabc-e9ad-4012-9666-dfaeced2e6a4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:05.824054 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:05.840281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857acc-e3a2-4a1f-a29d-b269e0dc8538 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:05.869947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949a30b-0bbd-4907-bcc5-b08af363a045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:05.870842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a30b-0bbd-4907-bcc5-b08af363a045 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.871127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a30b-0bbd-4907-bcc5-b08af363a045 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.871840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a30b-0bbd-4907-bcc5-b08af363a045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.872841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949a30b-0bbd-4907-bcc5-b08af363a045 None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=8bec5c8c626c40ef9906783916c49dd5) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:05.873216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949a30b-0bbd-4907-bcc5-b08af363a045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:05.874670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949a30b-0bbd-4907-bcc5-b08af363a045 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:05.876953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db909-da56-4ef9-b8c8-7a98b06ab80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:05.877739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db909-da56-4ef9-b8c8-7a98b06ab80f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:05.878164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db909-da56-4ef9-b8c8-7a98b06ab80f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:05.878582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db909-da56-4ef9-b8c8-7a98b06ab80f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:05.883549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 344/687] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:05 2022] GET /identity/v3/role_assignments?user.id=8bec5c8c626c40ef9906783916c49dd5&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:05.884488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949a30b-0bbd-4907-bcc5-b08af363a045 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:05.959852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591db909-da56-4ef9-b8c8-7a98b06ab80f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:05.961984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591db909-da56-4ef9-b8c8-7a98b06ab80f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:06.007962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949a30b-0bbd-4907-bcc5-b08af363a045 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:06.033982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:06.049048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bcfee-cc35-42ad-a87b-edc5d769588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:06.050210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bcfee-cc35-42ad-a87b-edc5d769588c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:06.050693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bcfee-cc35-42ad-a87b-edc5d769588c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:06.051450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bcfee-cc35-42ad-a87b-edc5d769588c None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:06.052569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bcfee-cc35-42ad-a87b-edc5d769588c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:06.053051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bcfee-cc35-42ad-a87b-edc5d769588c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:06.055605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bcfee-cc35-42ad-a87b-edc5d769588c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:06.068840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 345/688] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:06.076015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bcfee-cc35-42ad-a87b-edc5d769588c None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:06.091725 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:06.108841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 344/689] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 01:10:06.118290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db909-da56-4ef9-b8c8-7a98b06ab80f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:06.218919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bcfee-cc35-42ad-a87b-edc5d769588c None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:06.230311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db909-da56-4ef9-b8c8-7a98b06ab80f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:06.256566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7afa0-32b4-4989-8014-6fc27ffccf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:06.257299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7afa0-32b4-4989-8014-6fc27ffccf11 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:06.257584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7afa0-32b4-4989-8014-6fc27ffccf11 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:06.257862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7afa0-32b4-4989-8014-6fc27ffccf11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:06.269337 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4589af-045f-45cf-a2ea-6a37bfea510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:06.269697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7afa0-32b4-4989-8014-6fc27ffccf11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:06.269981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4589af-045f-45cf-a2ea-6a37bfea510e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:06.270262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4589af-045f-45cf-a2ea-6a37bfea510e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:06.270535 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4589af-045f-45cf-a2ea-6a37bfea510e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:06.271372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7afa0-32b4-4989-8014-6fc27ffccf11 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:06.282384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4589af-045f-45cf-a2ea-6a37bfea510e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:06.284051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4589af-045f-45cf-a2ea-6a37bfea510e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-88b7afa0-32b4-4989-8014-6fc27ffccf11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:06.287036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:06.287983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:06.288990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:06.288990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:06.288990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:06.288990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 346/690] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:06.297170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7afa0-32b4-4989-8014-6fc27ffccf11 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-fb4589af-045f-45cf-a2ea-6a37bfea510e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:06.305573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:06.307716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:06.309717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:06.309717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:06.309717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:06.309717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 345/691] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:06.314618 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4589af-045f-45cf-a2ea-6a37bfea510e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:06.346413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:06.363810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:06.415489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7afa0-32b4-4989-8014-6fc27ffccf11 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:06.428892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4589af-045f-45cf-a2ea-6a37bfea510e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:06.453139 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd4f44-c266-4da2-8d08-f638de99b89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:06.454077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd4f44-c266-4da2-8d08-f638de99b89a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:06.454512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd4f44-c266-4da2-8d08-f638de99b89a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:06.454945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd4f44-c266-4da2-8d08-f638de99b89a None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:06.455762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd4f44-c266-4da2-8d08-f638de99b89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:06.456254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd4f44-c266-4da2-8d08-f638de99b89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:06.457824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd4f44-c266-4da2-8d08-f638de99b89a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:06.467432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc1c63-806a-4cd7-91f1-7a6a40151f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:06.468048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc1c63-806a-4cd7-91f1-7a6a40151f4b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:06.468391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc1c63-806a-4cd7-91f1-7a6a40151f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:06.468772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc1c63-806a-4cd7-91f1-7a6a40151f4b None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:06.469582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc1c63-806a-4cd7-91f1-7a6a40151f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:06.469980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc1c63-806a-4cd7-91f1-7a6a40151f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:06.471441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc1c63-806a-4cd7-91f1-7a6a40151f4b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:06.472391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 347/692] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:06.478497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd4f44-c266-4da2-8d08-f638de99b89a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:06.490712 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 346/693] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:06.496824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc1c63-806a-4cd7-91f1-7a6a40151f4b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:06.601999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:06.606029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc1c63-806a-4cd7-91f1-7a6a40151f4b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:06.644600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddf954-82f2-4fb7-b3ea-4a9c044b3958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:06.645639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf954-82f2-4fb7-b3ea-4a9c044b3958 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:06.646193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf954-82f2-4fb7-b3ea-4a9c044b3958 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:06.646668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf954-82f2-4fb7-b3ea-4a9c044b3958 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:06.654297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddf954-82f2-4fb7-b3ea-4a9c044b3958 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:06.656433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:06.657010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddf954-82f2-4fb7-b3ea-4a9c044b3958 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:06.663370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd4f44-c266-4da2-8d08-f638de99b89a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-46ddf954-82f2-4fb7-b3ea-4a9c044b3958 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:06.670205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:06.671104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:06.672077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:06.672077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:06.672077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:06.672077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:06.672077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:06.672077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:06.672077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:06.672077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:06.675322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 347/694] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:06.676845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a14b-b1c5-4de3-bd04-95113469057d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:06.677326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a14b-b1c5-4de3-bd04-95113469057d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:06.677801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a14b-b1c5-4de3-bd04-95113469057d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:06.679506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 348/695] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:06.682868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a14b-b1c5-4de3-bd04-95113469057d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:06.707037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612f81-22a1-4266-b126-342c3445a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:06.707757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612f81-22a1-4266-b126-342c3445a570 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:06.707976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612f81-22a1-4266-b126-342c3445a570 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:06.708249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612f81-22a1-4266-b126-342c3445a570 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:06.716944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69612f81-22a1-4266-b126-342c3445a570 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:06.718999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69612f81-22a1-4266-b126-342c3445a570 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-69612f81-22a1-4266-b126-342c3445a570 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:06.734846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:06.736035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:06.736983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:06.736983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:06.736983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:06.736983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:06.736983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:06.736983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:06.736983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:06.736983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:06.736983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:06.736983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:06.739328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 348/696] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Sep 3 01:10:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:06.740784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4681d32-4954-4227-873b-2b570911791c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:06.741306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4681d32-4954-4227-873b-2b570911791c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:06.741788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4681d32-4954-4227-873b-2b570911791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:06.771297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-d4681d32-4954-4227-873b-2b570911791c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:06.773105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d4681d32-4954-4227-873b-2b570911791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:06.818356 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a14b-b1c5-4de3-bd04-95113469057d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:06.863813 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef2643-3e72-4dcc-8576-6b827e19c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:06.864478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef2643-3e72-4dcc-8576-6b827e19c229 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:06.864719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef2643-3e72-4dcc-8576-6b827e19c229 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:06.864896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef2643-3e72-4dcc-8576-6b827e19c229 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:06.865582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef2643-3e72-4dcc-8576-6b827e19c229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:06.865888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef2643-3e72-4dcc-8576-6b827e19c229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:06.867398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef2643-3e72-4dcc-8576-6b827e19c229 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:06.869033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 349/697] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:06.870162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4681d32-4954-4227-873b-2b570911791c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:06.887286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 349/698] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:06.896313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef2643-3e72-4dcc-8576-6b827e19c229 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:06.940572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:06.979967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:06.997670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4681d32-4954-4227-873b-2b570911791c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:07.044065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cdc88-17be-48df-bb20-9eabb412a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:07.045245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cdc88-17be-48df-bb20-9eabb412a9ab None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:07.047557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cdc88-17be-48df-bb20-9eabb412a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:07.047999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cdc88-17be-48df-bb20-9eabb412a9ab None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:07.048894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cdc88-17be-48df-bb20-9eabb412a9ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:07.050739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cdc88-17be-48df-bb20-9eabb412a9ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:07.053645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cdc88-17be-48df-bb20-9eabb412a9ab None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:07.091058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 350/699] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Sep 3 01:10:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:07.094788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cdc88-17be-48df-bb20-9eabb412a9ab None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:07.102994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef2643-3e72-4dcc-8576-6b827e19c229 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:07.177113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69acf5-1aa6-4313-97bd-b51c67398fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:07.177619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69acf5-1aa6-4313-97bd-b51c67398fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:07.177906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69acf5-1aa6-4313-97bd-b51c67398fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:07.178181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69acf5-1aa6-4313-97bd-b51c67398fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:07.178915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69acf5-1aa6-4313-97bd-b51c67398fc7 None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=4a844df7e3574911b6ea31e7d7bee715) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:07.179223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69acf5-1aa6-4313-97bd-b51c67398fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:07.181157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69acf5-1aa6-4313-97bd-b51c67398fc7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:07.199302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 350/700] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:06 2022] GET /identity/v3/role_assignments?user.id=4a844df7e3574911b6ea31e7d7bee715&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:07.213284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cdc88-17be-48df-bb20-9eabb412a9ab None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:07.259940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8f502-6aac-42bc-96ce-bf312bed0cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:07.260978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8f502-6aac-42bc-96ce-bf312bed0cea None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:07.261537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8f502-6aac-42bc-96ce-bf312bed0cea None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:07.262005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8f502-6aac-42bc-96ce-bf312bed0cea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:07.279765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:07.329645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69acf5-1aa6-4313-97bd-b51c67398fc7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:07.351293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8f502-6aac-42bc-96ce-bf312bed0cea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:07.351293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8f502-6aac-42bc-96ce-bf312bed0cea None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:07.445772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:07.461891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 351/701] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:10:07.463224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8f502-6aac-42bc-96ce-bf312bed0cea None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:07.464650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69acf5-1aa6-4313-97bd-b51c67398fc7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:07.506393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19831f-2e19-4e45-a519-7d2d47edbc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:07.507037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19831f-2e19-4e45-a519-7d2d47edbc63 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:07.507360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19831f-2e19-4e45-a519-7d2d47edbc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:07.507633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19831f-2e19-4e45-a519-7d2d47edbc63 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:07.508218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19831f-2e19-4e45-a519-7d2d47edbc63 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:07.509689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19831f-2e19-4e45-a519-7d2d47edbc63 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:07.514800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-dc19831f-2e19-4e45-a519-7d2d47edbc63 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:07.521895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:07.522982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:07.523870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 351/702] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Sep 3 01:10:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:07.531278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19831f-2e19-4e45-a519-7d2d47edbc63 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:07.587126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8f502-6aac-42bc-96ce-bf312bed0cea None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:07.632584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2eee1-f528-4bd1-bef6-5eb675b13ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:07.633224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2eee1-f528-4bd1-bef6-5eb675b13ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:07.633860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2eee1-f528-4bd1-bef6-5eb675b13ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:07.634138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2eee1-f528-4bd1-bef6-5eb675b13ab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:07.649738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2eee1-f528-4bd1-bef6-5eb675b13ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:07.651576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2eee1-f528-4bd1-bef6-5eb675b13ab4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:07.667286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19831f-2e19-4e45-a519-7d2d47edbc63 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-5bb2eee1-f528-4bd1-bef6-5eb675b13ab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:07.672368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:07.673518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:07.674389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:07.674389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:07.674389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:07.675087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 352/703] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:07.680809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2eee1-f528-4bd1-bef6-5eb675b13ab4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:07.716779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b0b6e-6c32-4ff2-a384-54910c6d5bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:07.717643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b0b6e-6c32-4ff2-a384-54910c6d5bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:07.717928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b0b6e-6c32-4ff2-a384-54910c6d5bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:07.718202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b0b6e-6c32-4ff2-a384-54910c6d5bb1 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:07.719102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b0b6e-6c32-4ff2-a384-54910c6d5bb1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:07.719899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b0b6e-6c32-4ff2-a384-54910c6d5bb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:07.721752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b0b6e-6c32-4ff2-a384-54910c6d5bb1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:07.728569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 352/704] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Sep 3 01:10:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:07.736322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b0b6e-6c32-4ff2-a384-54910c6d5bb1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:07.752738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:07.794556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:07.801471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2eee1-f528-4bd1-bef6-5eb675b13ab4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:07.845557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e05dd-caf9-4de3-be11-a954ebd928c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:07.846415 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e05dd-caf9-4de3-be11-a954ebd928c0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:07.846852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b0b6e-6c32-4ff2-a384-54910c6d5bb1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:07.847007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e05dd-caf9-4de3-be11-a954ebd928c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:07.847430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e05dd-caf9-4de3-be11-a954ebd928c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:07.848315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e05dd-caf9-4de3-be11-a954ebd928c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:07.848760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e05dd-caf9-4de3-be11-a954ebd928c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:07.850403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e05dd-caf9-4de3-be11-a954ebd928c0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:07.868369 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 353/705] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:07.869878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fbcf7-9435-4e5d-bc96-72831e296388 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:07.870226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fbcf7-9435-4e5d-bc96-72831e296388 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:07.870607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fbcf7-9435-4e5d-bc96-72831e296388 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:07.876449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 354/706] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:07.877955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7135-1663-49f8-800d-c6db197382b6 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:07.878302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7135-1663-49f8-800d-c6db197382b6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:07.878641 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7135-1663-49f8-800d-c6db197382b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:07.888466 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b44c43-1758-4747-b85e-bb4b01c104d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:07.889084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b44c43-1758-4747-b85e-bb4b01c104d2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:07.889361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b44c43-1758-4747-b85e-bb4b01c104d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:07.889638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b44c43-1758-4747-b85e-bb4b01c104d2 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:07.890261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b44c43-1758-4747-b85e-bb4b01c104d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:07.890559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b44c43-1758-4747-b85e-bb4b01c104d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:07.892163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b44c43-1758-4747-b85e-bb4b01c104d2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:07.898333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 353/707] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Sep 3 01:10:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:07.899293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b44c43-1758-4747-b85e-bb4b01c104d2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:07.900422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-c20f7135-1663-49f8-800d-c6db197382b6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:07.902056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c20f7135-1663-49f8-800d-c6db197382b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:08.039501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:08.043756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 355/708] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:08.087654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b44c43-1758-4747-b85e-bb4b01c104d2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:08.131043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc7064-083b-43c4-9f7d-1c1bab1a5111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:08.131744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc7064-083b-43c4-9f7d-1c1bab1a5111 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:08.132021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc7064-083b-43c4-9f7d-1c1bab1a5111 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:08.132292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc7064-083b-43c4-9f7d-1c1bab1a5111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:08.141857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc7064-083b-43c4-9f7d-1c1bab1a5111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:08.143547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc7064-083b-43c4-9f7d-1c1bab1a5111 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-16cc7064-083b-43c4-9f7d-1c1bab1a5111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:08.159080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:08.161213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:08.163304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:08.163304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:08.163304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:08.163304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:08.163304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:08.163304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:08.163304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:08.163304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:08.167273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 354/709] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:08.167477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f7135-1663-49f8-800d-c6db197382b6 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:08.302200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:08.323387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f7135-1663-49f8-800d-c6db197382b6 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:08.359404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc7064-083b-43c4-9f7d-1c1bab1a5111 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:08.367658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7081d-2882-4954-9260-6e388201cdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:08.368279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7081d-2882-4954-9260-6e388201cdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:08.368560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7081d-2882-4954-9260-6e388201cdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:08.368834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7081d-2882-4954-9260-6e388201cdd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:08.369542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7081d-2882-4954-9260-6e388201cdd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:08.369847 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7081d-2882-4954-9260-6e388201cdd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:08.371586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7081d-2882-4954-9260-6e388201cdd5 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:08.395670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 356/710] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:08.399542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7081d-2882-4954-9260-6e388201cdd5 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:08.509938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc7064-083b-43c4-9f7d-1c1bab1a5111 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:08.546649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcba28-3ecb-4d3c-86b9-3f6ec04873e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:08.547447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcba28-3ecb-4d3c-86b9-3f6ec04873e4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:08.547732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcba28-3ecb-4d3c-86b9-3f6ec04873e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:08.548006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcba28-3ecb-4d3c-86b9-3f6ec04873e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:08.550727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:08.555677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7081d-2882-4954-9260-6e388201cdd5 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:08.560716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcba28-3ecb-4d3c-86b9-3f6ec04873e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:08.562261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcba28-3ecb-4d3c-86b9-3f6ec04873e4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-eebcba28-3ecb-4d3c-86b9-3f6ec04873e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:08.578517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:08.579919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:08.580859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:08.580859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:08.580859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:08.580859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 355/711] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:08.581398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f7b67-f582-46fc-988e-eb1ad7c5f555 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:08.581499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f7b67-f582-46fc-988e-eb1ad7c5f555 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:08.581805 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f7b67-f582-46fc-988e-eb1ad7c5f555 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:08.587673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 356/712] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:08.588712 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df89295-7ec6-445e-bf28-ff0ac8fdd1df None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:08.589002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df89295-7ec6-445e-bf28-ff0ac8fdd1df None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:08.589254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df89295-7ec6-445e-bf28-ff0ac8fdd1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:08.596184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268c333-f6f1-4621-af2c-32c6864ecfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:08.597108 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268c333-f6f1-4621-af2c-32c6864ecfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:08.597640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268c333-f6f1-4621-af2c-32c6864ecfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:08.598111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268c333-f6f1-4621-af2c-32c6864ecfd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:08.599023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268c333-f6f1-4621-af2c-32c6864ecfd2 None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=9c4076fd5abc4b508a0215ce22af85d6) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:08.599545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268c333-f6f1-4621-af2c-32c6864ecfd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:08.601175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268c333-f6f1-4621-af2c-32c6864ecfd2 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:08.607831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 357/713] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:08 2022] GET /identity/v3/role_assignments?user.id=9c4076fd5abc4b508a0215ce22af85d6&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:08.608858 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268c333-f6f1-4621-af2c-32c6864ecfd2 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:08.608978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8df89295-7ec6-445e-bf28-ff0ac8fdd1df None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:08.610395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8df89295-7ec6-445e-bf28-ff0ac8fdd1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:08.626297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:08.704285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 357/714] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:08.813563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268c333-f6f1-4621-af2c-32c6864ecfd2 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:08.849375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e61e9-7792-4b38-a0ed-220dd3d5f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:08.850378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e61e9-7792-4b38-a0ed-220dd3d5f416 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:08.850880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e61e9-7792-4b38-a0ed-220dd3d5f416 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:08.851419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e61e9-7792-4b38-a0ed-220dd3d5f416 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:08.852281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e61e9-7792-4b38-a0ed-220dd3d5f416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:08.852835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e61e9-7792-4b38-a0ed-220dd3d5f416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:08.854468 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e61e9-7792-4b38-a0ed-220dd3d5f416 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:08.869488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 358/715] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:08.875118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df89295-7ec6-445e-bf28-ff0ac8fdd1df None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:09.011282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df89295-7ec6-445e-bf28-ff0ac8fdd1df None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:09.028834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e61e9-7792-4b38-a0ed-220dd3d5f416 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:09.044216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:09.078464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b36e9e-b79d-4181-ae02-0fb5aeb878a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:09.079457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b36e9e-b79d-4181-ae02-0fb5aeb878a0 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:09.079944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b36e9e-b79d-4181-ae02-0fb5aeb878a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:09.081586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b36e9e-b79d-4181-ae02-0fb5aeb878a0 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:09.082437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b36e9e-b79d-4181-ae02-0fb5aeb878a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:09.085274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b36e9e-b79d-4181-ae02-0fb5aeb878a0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:09.118861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 358/716] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:10:08 2022] POST /identity/v3/users => generated 254 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:10:09.155482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:09.195677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e61e9-7792-4b38-a0ed-220dd3d5f416 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:09.234205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354551b-3033-467d-899e-d232c24b8abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:09.235365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354551b-3033-467d-899e-d232c24b8abc None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:09.235878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354551b-3033-467d-899e-d232c24b8abc None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:09.236347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354551b-3033-467d-899e-d232c24b8abc None admin] PATH_INFO: `/v3/services/network` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:09.237122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354551b-3033-467d-899e-d232c24b8abc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:09.238757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354551b-3033-467d-899e-d232c24b8abc None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-f354551b-3033-467d-899e-d232c24b8abc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:09.251010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:09.252104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 01:10:09.252943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:09.256009 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 359/717] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:09 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:09.262039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b36e9e-b79d-4181-ae02-0fb5aeb878a0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:09.392612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b36e9e-b79d-4181-ae02-0fb5aeb878a0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:09.434782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10042a83-e4a9-4cda-b0c6-5cdf515becfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:09.435447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10042a83-e4a9-4cda-b0c6-5cdf515becfb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:09.435723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10042a83-e4a9-4cda-b0c6-5cdf515becfb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:09.435993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10042a83-e4a9-4cda-b0c6-5cdf515becfb None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:09.436640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10042a83-e4a9-4cda-b0c6-5cdf515becfb None admin] RBAC: Adding query filter params (name=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:09.436935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10042a83-e4a9-4cda-b0c6-5cdf515becfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:09.438477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10042a83-e4a9-4cda-b0c6-5cdf515becfb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:09.448143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 359/718] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:09.453707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354551b-3033-467d-899e-d232c24b8abc None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:09.554898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354551b-3033-467d-899e-d232c24b8abc None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:09.590416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b912c-2aa8-4a72-869b-d3de4b0ca6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:09.591413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b912c-2aa8-4a72-869b-d3de4b0ca6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:09.591889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b912c-2aa8-4a72-869b-d3de4b0ca6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:09.592369 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b912c-2aa8-4a72-869b-d3de4b0ca6f9 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:09.593199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b912c-2aa8-4a72-869b-d3de4b0ca6f9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:09.593704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b912c-2aa8-4a72-869b-d3de4b0ca6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:09.595541 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b912c-2aa8-4a72-869b-d3de4b0ca6f9 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:09.597239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:09.601964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 360/719] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:09.753405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c590b-f655-48de-9b1a-e5004c0dfe26 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:09.753750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c590b-f655-48de-9b1a-e5004c0dfe26 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:09.753924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c590b-f655-48de-9b1a-e5004c0dfe26 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:09.755362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 360/720] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:09.760565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d03f7-8196-4a80-9c20-eac4c5fe68ce None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:09.761070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d03f7-8196-4a80-9c20-eac4c5fe68ce None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:09.761557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d03f7-8196-4a80-9c20-eac4c5fe68ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:09.783511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-787d03f7-8196-4a80-9c20-eac4c5fe68ce None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:09.784701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-787d03f7-8196-4a80-9c20-eac4c5fe68ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:09.860536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 361/721] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:10.127463 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c590b-f655-48de-9b1a-e5004c0dfe26 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:10.169464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:10.237565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c590b-f655-48de-9b1a-e5004c0dfe26 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:10.271545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80d126-cff6-45ee-a732-973396671d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:10.272178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80d126-cff6-45ee-a732-973396671d45 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:10.272452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80d126-cff6-45ee-a732-973396671d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:10.272718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80d126-cff6-45ee-a732-973396671d45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:10.289561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80d126-cff6-45ee-a732-973396671d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0d80d126-cff6-45ee-a732-973396671d45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:10.294885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:10.295847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:10.296705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 361/722] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:10.302269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d03f7-8196-4a80-9c20-eac4c5fe68ce None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:10.386752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcb4c5-8ef6-4111-b9f3-8d4bd0d4d9cf None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:10.386945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcb4c5-8ef6-4111-b9f3-8d4bd0d4d9cf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:10.387204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcb4c5-8ef6-4111-b9f3-8d4bd0d4d9cf None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:10.388562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 362/723] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:10.400239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a287a3e-4ce6-4175-a1b1-6b7dda2d6bd9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:10.400522 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a287a3e-4ce6-4175-a1b1-6b7dda2d6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:10.400795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a287a3e-4ce6-4175-a1b1-6b7dda2d6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:10.423479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d03f7-8196-4a80-9c20-eac4c5fe68ce None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:10.440281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5a287a3e-4ce6-4175-a1b1-6b7dda2d6bd9 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:10.441502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5a287a3e-4ce6-4175-a1b1-6b7dda2d6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:10.456345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:10.468980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec42af-6153-48bf-a300-ba360d2bce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:10.470256 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec42af-6153-48bf-a300-ba360d2bce95 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:10.472049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec42af-6153-48bf-a300-ba360d2bce95 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:10.472596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec42af-6153-48bf-a300-ba360d2bce95 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:10.473527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec42af-6153-48bf-a300-ba360d2bce95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:10.474813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec42af-6153-48bf-a300-ba360d2bce95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:10.477089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec42af-6153-48bf-a300-ba360d2bce95 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:10.492985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 362/724] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:10.498510 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec42af-6153-48bf-a300-ba360d2bce95 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:10.577550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 363/725] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:10.637002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec42af-6153-48bf-a300-ba360d2bce95 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:10.678665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a56c5-5c0c-44db-975a-c0156e524eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:10.679329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a56c5-5c0c-44db-975a-c0156e524eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:10.679616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a56c5-5c0c-44db-975a-c0156e524eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:10.679890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a56c5-5c0c-44db-975a-c0156e524eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:10.691129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a56c5-5c0c-44db-975a-c0156e524eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:10.692633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a56c5-5c0c-44db-975a-c0156e524eb8 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-a27a56c5-5c0c-44db-975a-c0156e524eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:10.713732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:10.714685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:10.715623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:10.715623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:10.715623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:10.715623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 363/726] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:10.720648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a287a3e-4ce6-4175-a1b1-6b7dda2d6bd9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:10.757180 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:10.853888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a287a3e-4ce6-4175-a1b1-6b7dda2d6bd9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:10.900114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120f62c-a4c1-486f-b4f7-aaa4b1be7733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:10.900419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a56c5-5c0c-44db-975a-c0156e524eb8 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:10.900843 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120f62c-a4c1-486f-b4f7-aaa4b1be7733 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:10.900931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120f62c-a4c1-486f-b4f7-aaa4b1be7733 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:10.901210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120f62c-a4c1-486f-b4f7-aaa4b1be7733 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:10.901817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120f62c-a4c1-486f-b4f7-aaa4b1be7733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:10.902112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120f62c-a4c1-486f-b4f7-aaa4b1be7733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:10.903512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120f62c-a4c1-486f-b4f7-aaa4b1be7733 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:10.916163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 364/727] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:10.921464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120f62c-a4c1-486f-b4f7-aaa4b1be7733 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:10.976581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:11.034624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:11.055533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120f62c-a4c1-486f-b4f7-aaa4b1be7733 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:11.082541 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a56c5-5c0c-44db-975a-c0156e524eb8 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:11.127296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6528c-152c-488b-9bd6-62417549829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:11.127919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6528c-152c-488b-9bd6-62417549829d None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:11.128195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6528c-152c-488b-9bd6-62417549829d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:11.128470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6528c-152c-488b-9bd6-62417549829d None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:11.129127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6528c-152c-488b-9bd6-62417549829d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:11.130512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6528c-152c-488b-9bd6-62417549829d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:11.134724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e8ba7-5ee0-47e7-8ced-d6628bb9f973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:11.136036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e8ba7-5ee0-47e7-8ced-d6628bb9f973 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:11.136541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e8ba7-5ee0-47e7-8ced-d6628bb9f973 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:11.137132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e8ba7-5ee0-47e7-8ced-d6628bb9f973 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:11.154072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 364/728] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:10:10 2022] POST /identity/v3/services => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:10:11.154985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e8ba7-5ee0-47e7-8ced-d6628bb9f973 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:11.156682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e8ba7-5ee0-47e7-8ced-d6628bb9f973 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:11.163304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c20cc-40a0-4c5e-9710-f89917231de7 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:11.163638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c20cc-40a0-4c5e-9710-f89917231de7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:11.163922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c20cc-40a0-4c5e-9710-f89917231de7 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:11.165573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 365/729] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1f7e8ba7-5ee0-47e7-8ced-d6628bb9f973 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:11.170609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:11.171603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:11.173037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:11.173037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:11.173037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:11.173037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:11.173037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:11.173037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:11.173037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:11.173037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:11.173037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:10:11.173037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:11.173578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333b670-908f-450e-b1bb-778973fd30af None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:11.173578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333b670-908f-450e-b1bb-778973fd30af None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:11.173704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 365/730] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:11.173779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333b670-908f-450e-b1bb-778973fd30af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:11.182087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e8ba7-5ee0-47e7-8ced-d6628bb9f973 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:11.193643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2333b670-908f-450e-b1bb-778973fd30af None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:11.194903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2333b670-908f-450e-b1bb-778973fd30af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:11.333877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 366/731] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 01:10:11.376187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e8ba7-5ee0-47e7-8ced-d6628bb9f973 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:11.412921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3069-e35c-4cc3-88eb-a41ca983e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:11.413514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3069-e35c-4cc3-88eb-a41ca983e865 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:11.413795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3069-e35c-4cc3-88eb-a41ca983e865 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:11.414069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3069-e35c-4cc3-88eb-a41ca983e865 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:11.414899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3069-e35c-4cc3-88eb-a41ca983e865 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:11.415269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3069-e35c-4cc3-88eb-a41ca983e865 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:11.416705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3069-e35c-4cc3-88eb-a41ca983e865 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:11.435859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 366/732] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Sep 3 01:10:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:11.441528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333b670-908f-450e-b1bb-778973fd30af None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:11.476596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:11.553536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333b670-908f-450e-b1bb-778973fd30af None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:11.597046 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e6a9-a644-42fa-b6cf-4045185d801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:11.597659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e6a9-a644-42fa-b6cf-4045185d801c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:11.597936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e6a9-a644-42fa-b6cf-4045185d801c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:11.598207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e6a9-a644-42fa-b6cf-4045185d801c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:11.631961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3069-e35c-4cc3-88eb-a41ca983e865 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:11.655289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:11.670362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e6a9-a644-42fa-b6cf-4045185d801c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:11.671802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e6a9-a644-42fa-b6cf-4045185d801c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:11.706096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:11.833762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3069-e35c-4cc3-88eb-a41ca983e865 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:11.844793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 367/733] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:11 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 01:10:11.850280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e6a9-a644-42fa-b6cf-4045185d801c None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:11.898388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc13b07-c80c-4da4-a7ef-c52a9b912241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:11.899034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc13b07-c80c-4da4-a7ef-c52a9b912241 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:11.899341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc13b07-c80c-4da4-a7ef-c52a9b912241 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:11.899611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc13b07-c80c-4da4-a7ef-c52a9b912241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:11.910738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc13b07-c80c-4da4-a7ef-c52a9b912241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4dc13b07-c80c-4da4-a7ef-c52a9b912241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:11.915882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:11.916806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:11.917647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 367/734] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:11.918802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358651e0-eb13-4abf-a342-588e87577d98 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:11.918970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358651e0-eb13-4abf-a342-588e87577d98 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:11.923286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358651e0-eb13-4abf-a342-588e87577d98 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:11.923286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 368/735] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:11.923286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358651e0-eb13-4abf-a342-588e87577d98 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:11.979669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e6a9-a644-42fa-b6cf-4045185d801c None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:12.007660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:12.012256 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:12.023975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565c60b-9fb5-4ac4-92aa-5295db456755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:12.024609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c60b-9fb5-4ac4-92aa-5295db456755 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.024885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c60b-9fb5-4ac4-92aa-5295db456755 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.025156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c60b-9fb5-4ac4-92aa-5295db456755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.035971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565c60b-9fb5-4ac4-92aa-5295db456755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:12.037460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565c60b-9fb5-4ac4-92aa-5295db456755 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:12.049993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358651e0-eb13-4abf-a342-588e87577d98 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-1565c60b-9fb5-4ac4-92aa-5295db456755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:12.052538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:12.053453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:12.054346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:12.054346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:12.054346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:12.054346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 368/736] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:12.059481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6ceff-4496-4ca1-9aa9-92bf6afbd47c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.059481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6ceff-4496-4ca1-9aa9-92bf6afbd47c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.059481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6ceff-4496-4ca1-9aa9-92bf6afbd47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.074514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-89a6ceff-4496-4ca1-9aa9-92bf6afbd47c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:12.075734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-89a6ceff-4496-4ca1-9aa9-92bf6afbd47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:12.090178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73a8d7-db18-4ee7-89ed-8550fe758b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:12.091012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73a8d7-db18-4ee7-89ed-8550fe758b7a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.091461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73a8d7-db18-4ee7-89ed-8550fe758b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.091877 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73a8d7-db18-4ee7-89ed-8550fe758b7a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.092792 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73a8d7-db18-4ee7-89ed-8550fe758b7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:12.093309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73a8d7-db18-4ee7-89ed-8550fe758b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:12.094993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73a8d7-db18-4ee7-89ed-8550fe758b7a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:12.104602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 369/737] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:12.106377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895a17-a81c-49fb-8b91-3085304275c8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.106662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895a17-a81c-49fb-8b91-3085304275c8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.106935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895a17-a81c-49fb-8b91-3085304275c8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.108268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 370/738] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:12.112245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c895a17-a81c-49fb-8b91-3085304275c8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:12.146098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 369/739] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:12.147015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6ceff-4496-4ca1-9aa9-92bf6afbd47c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:12.221860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c895a17-a81c-49fb-8b91-3085304275c8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:12.248160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6ceff-4496-4ca1-9aa9-92bf6afbd47c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:12.250960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:12.259281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3a867-d211-4710-a5a4-faff2f16378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:12.259620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:12.260464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a867-d211-4710-a5a4-faff2f16378e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.260990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a867-d211-4710-a5a4-faff2f16378e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.261500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a867-d211-4710-a5a4-faff2f16378e None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.263067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3a867-d211-4710-a5a4-faff2f16378e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:12.263598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3a867-d211-4710-a5a4-faff2f16378e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:12.265208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3a867-d211-4710-a5a4-faff2f16378e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:12.281756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 371/740] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:12.281756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e3584-abdd-421b-910e-29aad4f4f46d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.281756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e3584-abdd-421b-910e-29aad4f4f46d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.281756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e3584-abdd-421b-910e-29aad4f4f46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.286554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9186-8b23-4903-acad-d146ecebfcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:12.287550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9186-8b23-4903-acad-d146ecebfcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.288029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9186-8b23-4903-acad-d146ecebfcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.288818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9186-8b23-4903-acad-d146ecebfcf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.301845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-870e3584-abdd-421b-910e-29aad4f4f46d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:12.302617 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df9186-8b23-4903-acad-d146ecebfcf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:12.303033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-870e3584-abdd-421b-910e-29aad4f4f46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:12.304583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df9186-8b23-4903-acad-d146ecebfcf3 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-a2df9186-8b23-4903-acad-d146ecebfcf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:12.325562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:12.326562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:12.327494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:12.327494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:12.327494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:12.333610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 370/741] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:12.333610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9186-8b23-4903-acad-d146ecebfcf3 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:12.386061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 372/742] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 01:10:12.387353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e3584-abdd-421b-910e-29aad4f4f46d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:12.434235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9186-8b23-4903-acad-d146ecebfcf3 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:12.468194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711e1c8-2818-4502-bbc5-408bcbabe65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:12.468882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711e1c8-2818-4502-bbc5-408bcbabe65a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.469164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711e1c8-2818-4502-bbc5-408bcbabe65a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.469432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711e1c8-2818-4502-bbc5-408bcbabe65a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.476727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711e1c8-2818-4502-bbc5-408bcbabe65a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:12.478188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711e1c8-2818-4502-bbc5-408bcbabe65a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-e711e1c8-2818-4502-bbc5-408bcbabe65a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:12.490329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:12.491320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:12.492218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:12.492218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:12.492218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:12.492218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:12.492218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:12.492218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:12.492218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:12.492218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:12.492218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 371/743] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:12.497126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711e1c8-2818-4502-bbc5-408bcbabe65a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:12.502997 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e3584-abdd-421b-910e-29aad4f4f46d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:12.521761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:12.523746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:12.542122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0168-11cc-4325-8b6e-2c1e6c577b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:12.543934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0168-11cc-4325-8b6e-2c1e6c577b9d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.544422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0168-11cc-4325-8b6e-2c1e6c577b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.545067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0168-11cc-4325-8b6e-2c1e6c577b9d None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.545942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d0168-11cc-4325-8b6e-2c1e6c577b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:12.546452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d0168-11cc-4325-8b6e-2c1e6c577b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:12.548338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d0168-11cc-4325-8b6e-2c1e6c577b9d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:12.561204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 373/744] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:12.566973 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0168-11cc-4325-8b6e-2c1e6c577b9d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:12.597610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711e1c8-2818-4502-bbc5-408bcbabe65a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:12.635196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf595-d2ed-48bb-b248-28ee5cee9e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:12.636199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf595-d2ed-48bb-b248-28ee5cee9e3f None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.636770 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf595-d2ed-48bb-b248-28ee5cee9e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.637268 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf595-d2ed-48bb-b248-28ee5cee9e3f None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.638164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaf595-d2ed-48bb-b248-28ee5cee9e3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:12.639849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaf595-d2ed-48bb-b248-28ee5cee9e3f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:12.661318 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 372/745] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:10:12 2022] POST /identity/v3/services => generated 240 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:12.662175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf595-d2ed-48bb-b248-28ee5cee9e3f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:12.685997 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0168-11cc-4325-8b6e-2c1e6c577b9d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:12.738163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa9047-5ea3-4ae1-886f-8ea4b301b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:12.739303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa9047-5ea3-4ae1-886f-8ea4b301b481 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.739782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa9047-5ea3-4ae1-886f-8ea4b301b481 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.740254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa9047-5ea3-4ae1-886f-8ea4b301b481 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.741174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa9047-5ea3-4ae1-886f-8ea4b301b481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:12.741689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa9047-5ea3-4ae1-886f-8ea4b301b481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:12.743619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa9047-5ea3-4ae1-886f-8ea4b301b481 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:12.750619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:12.759543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 374/746] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:12.760778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa9047-5ea3-4ae1-886f-8ea4b301b481 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:12.776654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf595-d2ed-48bb-b248-28ee5cee9e3f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:12.802143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:12.813871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c1442-614b-4a66-a3cd-f93f13046345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:12.814521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1442-614b-4a66-a3cd-f93f13046345 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.814798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1442-614b-4a66-a3cd-f93f13046345 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.815057 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1442-614b-4a66-a3cd-f93f13046345 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.823406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c1442-614b-4a66-a3cd-f93f13046345 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:12.824953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c1442-614b-4a66-a3cd-f93f13046345 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-bd9c1442-614b-4a66-a3cd-f93f13046345 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:12.837689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:12.838781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:12.839752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:12.839752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:12.839752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:12.839752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:12.839752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:12.839752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:12.839752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:12.839752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:12.839752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:12.839752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:12.843367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 373/747] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Sep 3 01:10:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:12.844314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c1442-614b-4a66-a3cd-f93f13046345 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:12.891698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa9047-5ea3-4ae1-886f-8ea4b301b481 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:12.927080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef945f-afeb-418f-91b1-9f7c200e827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:12.927763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef945f-afeb-418f-91b1-9f7c200e827e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:12.928035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef945f-afeb-418f-91b1-9f7c200e827e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:12.928298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef945f-afeb-418f-91b1-9f7c200e827e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:12.938667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef945f-afeb-418f-91b1-9f7c200e827e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a3ef945f-afeb-418f-91b1-9f7c200e827e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:12.943894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:12.944851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:12.945701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 375/748] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:10:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:12.946394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef945f-afeb-418f-91b1-9f7c200e827e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:12.980246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c1442-614b-4a66-a3cd-f93f13046345 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:13.024956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33fa9e-33ab-45ee-af6e-87dfc50c6485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:13.026221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33fa9e-33ab-45ee-af6e-87dfc50c6485 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:13.026772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33fa9e-33ab-45ee-af6e-87dfc50c6485 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:13.027217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33fa9e-33ab-45ee-af6e-87dfc50c6485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:13.028261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33fa9e-33ab-45ee-af6e-87dfc50c6485 None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=4a844df7e3574911b6ea31e7d7bee715) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:13.028713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33fa9e-33ab-45ee-af6e-87dfc50c6485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:13.030939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33fa9e-33ab-45ee-af6e-87dfc50c6485 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:13.038779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 374/749] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:12 2022] GET /identity/v3/role_assignments?user.id=4a844df7e3574911b6ea31e7d7bee715&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:13.047418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33fa9e-33ab-45ee-af6e-87dfc50c6485 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:13.054604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:13.066374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:13.069364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef945f-afeb-418f-91b1-9f7c200e827e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:13.141026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dc3b2-31c9-463f-a883-83922beb3f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:13.141871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc3b2-31c9-463f-a883-83922beb3f40 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:13.142237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc3b2-31c9-463f-a883-83922beb3f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:13.142595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc3b2-31c9-463f-a883-83922beb3f40 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:13.143467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dc3b2-31c9-463f-a883-83922beb3f40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:13.145615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dc3b2-31c9-463f-a883-83922beb3f40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:13.147216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dc3b2-31c9-463f-a883-83922beb3f40 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:13.185189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 376/750] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Sep 3 01:10:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:13.191370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dc3b2-31c9-463f-a883-83922beb3f40 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:13.236924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33fa9e-33ab-45ee-af6e-87dfc50c6485 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:13.275025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025d116-4f9b-4a99-bae1-25fd4fe2781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:13.275947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025d116-4f9b-4a99-bae1-25fd4fe2781b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:13.276370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025d116-4f9b-4a99-bae1-25fd4fe2781b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:13.276781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025d116-4f9b-4a99-bae1-25fd4fe2781b None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:13.277586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025d116-4f9b-4a99-bae1-25fd4fe2781b None admin] RBAC: Adding query filter params (name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:13.278028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025d116-4f9b-4a99-bae1-25fd4fe2781b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:13.279593 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025d116-4f9b-4a99-bae1-25fd4fe2781b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:13.288704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 375/751] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:10:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:13.304679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025d116-4f9b-4a99-bae1-25fd4fe2781b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:13.330908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dc3b2-31c9-463f-a883-83922beb3f40 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:13.368044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c87aa-0798-44ce-af78-8b63e6c34cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:13.368682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c87aa-0798-44ce-af78-8b63e6c34cef None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:13.368959 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c87aa-0798-44ce-af78-8b63e6c34cef None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:13.369231 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c87aa-0798-44ce-af78-8b63e6c34cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:13.380104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c87aa-0798-44ce-af78-8b63e6c34cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:13.381565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c87aa-0798-44ce-af78-8b63e6c34cef None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:13.388832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1c6c87aa-0798-44ce-af78-8b63e6c34cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:13.396773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:13.397762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:13.398701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:13.398701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:13.398701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:13.398701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 377/752] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:13.412330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c87aa-0798-44ce-af78-8b63e6c34cef None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:13.419130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:13.453797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025d116-4f9b-4a99-bae1-25fd4fe2781b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:13.506535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35634352-f7bb-48a4-b0ef-a750d86df129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:13.507175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35634352-f7bb-48a4-b0ef-a750d86df129 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:13.507478 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35634352-f7bb-48a4-b0ef-a750d86df129 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:13.507750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35634352-f7bb-48a4-b0ef-a750d86df129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:13.519602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35634352-f7bb-48a4-b0ef-a750d86df129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:13.521153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35634352-f7bb-48a4-b0ef-a750d86df129 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-35634352-f7bb-48a4-b0ef-a750d86df129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:13.536307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:13.537289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:13.538588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:13.538588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:13.538588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:13.538588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 376/753] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:13.539373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71046-d576-40ed-aa22-da44b1c859da None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:13.539373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71046-d576-40ed-aa22-da44b1c859da None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:13.539645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71046-d576-40ed-aa22-da44b1c859da None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:13.545142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 377/754] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:13.546000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d71046-d576-40ed-aa22-da44b1c859da None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:13.550640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c87aa-0798-44ce-af78-8b63e6c34cef None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:13.588710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4327b1-ae00-4ca7-a751-d84012a3ac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:13.589378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4327b1-ae00-4ca7-a751-d84012a3ac47 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:13.589652 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4327b1-ae00-4ca7-a751-d84012a3ac47 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:13.589922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4327b1-ae00-4ca7-a751-d84012a3ac47 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:13.590690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4327b1-ae00-4ca7-a751-d84012a3ac47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:13.590989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4327b1-ae00-4ca7-a751-d84012a3ac47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:13.592416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4327b1-ae00-4ca7-a751-d84012a3ac47 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:13.604941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 378/755] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:13.611099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc170d-905c-43d4-8f8a-fbac347dfe3b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:13.611419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc170d-905c-43d4-8f8a-fbac347dfe3b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:13.611689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc170d-905c-43d4-8f8a-fbac347dfe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:13.630900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b9bc170d-905c-43d4-8f8a-fbac347dfe3b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:13.632161 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b9bc170d-905c-43d4-8f8a-fbac347dfe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:13.659725 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d71046-d576-40ed-aa22-da44b1c859da None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:13.684088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:13.692867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:13.701370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 379/756] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:13.702356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8bafa-1f46-4a05-8e01-8a7c156f0122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:13.703338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8bafa-1f46-4a05-8e01-8a7c156f0122 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:13.703759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8bafa-1f46-4a05-8e01-8a7c156f0122 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:13.704219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8bafa-1f46-4a05-8e01-8a7c156f0122 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:13.705008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8bafa-1f46-4a05-8e01-8a7c156f0122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:13.705459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8bafa-1f46-4a05-8e01-8a7c156f0122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:13.706981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8bafa-1f46-4a05-8e01-8a7c156f0122 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:13.708211 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc170d-905c-43d4-8f8a-fbac347dfe3b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:13.719636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 378/757] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:13.730663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8bafa-1f46-4a05-8e01-8a7c156f0122 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:13.847703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8bafa-1f46-4a05-8e01-8a7c156f0122 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:13.885622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ba9a-6d1e-4168-96e3-86ab4cec701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:13.886513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ba9a-6d1e-4168-96e3-86ab4cec701d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:13.886951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ba9a-6d1e-4168-96e3-86ab4cec701d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:13.887562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ba9a-6d1e-4168-96e3-86ab4cec701d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:13.896572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776ba9a-6d1e-4168-96e3-86ab4cec701d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:13.898459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776ba9a-6d1e-4168-96e3-86ab4cec701d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-9776ba9a-6d1e-4168-96e3-86ab4cec701d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:13.911774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:13.912917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:13.914070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:13.914070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:13.914070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:13.914070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:13.914070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:13.914070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:13.914070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:13.914070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:13.914070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:13.914070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:13.916724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 379/758] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Sep 3 01:10:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:13.922611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ba9a-6d1e-4168-96e3-86ab4cec701d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:13.981667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc170d-905c-43d4-8f8a-fbac347dfe3b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:13.989714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:14.031555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b759c-a54d-4876-82a1-b7152af03dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:14.032755 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b759c-a54d-4876-82a1-b7152af03dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:14.033040 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b759c-a54d-4876-82a1-b7152af03dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:14.033335 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b759c-a54d-4876-82a1-b7152af03dc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:14.042890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b759c-a54d-4876-82a1-b7152af03dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:14.044471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b759c-a54d-4876-82a1-b7152af03dc0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:14.055050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ba9a-6d1e-4168-96e3-86ab4cec701d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-790b759c-a54d-4876-82a1-b7152af03dc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:14.056434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:14.057327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:14.058227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:14.058227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:14.058227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:14.058227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:14.058227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:14.058227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:14.058227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:14.058227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:14.058227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 380/759] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:14.058723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b759c-a54d-4876-82a1-b7152af03dc0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:14.091735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ae21c-6095-4d5c-9162-6dd0f13ef8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:14.092344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ae21c-6095-4d5c-9162-6dd0f13ef8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:14.092622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ae21c-6095-4d5c-9162-6dd0f13ef8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:14.092895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ae21c-6095-4d5c-9162-6dd0f13ef8f4 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:14.093647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ae21c-6095-4d5c-9162-6dd0f13ef8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:14.094495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ae21c-6095-4d5c-9162-6dd0f13ef8f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:14.095995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ae21c-6095-4d5c-9162-6dd0f13ef8f4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:14.116871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:14.169792 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b759c-a54d-4876-82a1-b7152af03dc0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:14.208620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974b60-bbd5-4585-9bb3-e0045d09de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:14.209546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974b60-bbd5-4585-9bb3-e0045d09de5d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:14.209964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974b60-bbd5-4585-9bb3-e0045d09de5d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:14.210373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974b60-bbd5-4585-9bb3-e0045d09de5d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:14.211126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae974b60-bbd5-4585-9bb3-e0045d09de5d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:14.212717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae974b60-bbd5-4585-9bb3-e0045d09de5d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ae974b60-bbd5-4585-9bb3-e0045d09de5d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:14.222857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:14.224136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 01:10:14.225044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:14.227395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 381/760] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Sep 3 01:10:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:14.228384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974b60-bbd5-4585-9bb3-e0045d09de5d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:14.251280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 380/761] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Sep 3 01:10:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:14.256503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ae21c-6095-4d5c-9162-6dd0f13ef8f4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:14.337743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974b60-bbd5-4585-9bb3-e0045d09de5d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:14.356625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:14.362878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:14.367005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ae21c-6095-4d5c-9162-6dd0f13ef8f4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:14.378395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1521b-4625-45b0-a10f-f7de9fc09224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:14.379388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1521b-4625-45b0-a10f-f7de9fc09224 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:14.379828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1521b-4625-45b0-a10f-f7de9fc09224 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:14.380244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1521b-4625-45b0-a10f-f7de9fc09224 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:14.381070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1521b-4625-45b0-a10f-f7de9fc09224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:14.381509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1521b-4625-45b0-a10f-f7de9fc09224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:14.383207 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1521b-4625-45b0-a10f-f7de9fc09224 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:14.396403 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 382/762] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:14.397424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1521b-4625-45b0-a10f-f7de9fc09224 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:14.404093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49a937-4454-4edc-9842-4fd175de4aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:14.404707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49a937-4454-4edc-9842-4fd175de4aec None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:14.404984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49a937-4454-4edc-9842-4fd175de4aec None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:14.405252 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49a937-4454-4edc-9842-4fd175de4aec None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:14.405880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49a937-4454-4edc-9842-4fd175de4aec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:14.406210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49a937-4454-4edc-9842-4fd175de4aec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:14.408470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49a937-4454-4edc-9842-4fd175de4aec None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:14.413406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 381/763] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Sep 3 01:10:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:14.414242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49a937-4454-4edc-9842-4fd175de4aec None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:14.506785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1521b-4625-45b0-a10f-f7de9fc09224 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:14.521491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49a937-4454-4edc-9842-4fd175de4aec None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:14.543741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686cb29-154e-49e2-b026-31275f28c683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:14.544648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686cb29-154e-49e2-b026-31275f28c683 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:14.545063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686cb29-154e-49e2-b026-31275f28c683 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:14.545508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686cb29-154e-49e2-b026-31275f28c683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:14.559852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5e74e-dc84-49ae-8e3a-1bd6409d864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:14.560653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e74e-dc84-49ae-8e3a-1bd6409d864a None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:14.560935 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e74e-dc84-49ae-8e3a-1bd6409d864a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:14.561208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e74e-dc84-49ae-8e3a-1bd6409d864a None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/9c4076fd5abc4b508a0215ce22af85d6/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:14.563684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5e74e-dc84-49ae-8e3a-1bd6409d864a None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=9c4076fd5abc4b508a0215ce22af85d6, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:14.565103 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5e74e-dc84-49ae-8e3a-1bd6409d864a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:14.582087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 382/764] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:10:14 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/9c4076fd5abc4b508a0215ce22af85d6/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:10:14.583109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5e74e-dc84-49ae-8e3a-1bd6409d864a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:14.607391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:14.611861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:14.639805 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686cb29-154e-49e2-b026-31275f28c683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:14.641733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686cb29-154e-49e2-b026-31275f28c683 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:14.733404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5e74e-dc84-49ae-8e3a-1bd6409d864a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:14.755573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 383/765] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:10:14.761433 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686cb29-154e-49e2-b026-31275f28c683 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:14.810226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf33470-314c-4c38-aaa7-4188e200098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:14.811455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33470-314c-4c38-aaa7-4188e200098a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:14.811940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33470-314c-4c38-aaa7-4188e200098a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:14.812553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33470-314c-4c38-aaa7-4188e200098a None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:14.813658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf33470-314c-4c38-aaa7-4188e200098a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:14.814337 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf33470-314c-4c38-aaa7-4188e200098a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:14.816007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf33470-314c-4c38-aaa7-4188e200098a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:14.822522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 383/766] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Sep 3 01:10:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:14.829306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf33470-314c-4c38-aaa7-4188e200098a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:14.893643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:14.924570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686cb29-154e-49e2-b026-31275f28c683 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:14.933698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:14.957972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf33470-314c-4c38-aaa7-4188e200098a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:14.972572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc551d-97b9-4940-a57a-38d17711d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:14.973674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc551d-97b9-4940-a57a-38d17711d23e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:14.974122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc551d-97b9-4940-a57a-38d17711d23e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:14.974774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc551d-97b9-4940-a57a-38d17711d23e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:14.989746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc551d-97b9-4940-a57a-38d17711d23e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:14.992079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc551d-97b9-4940-a57a-38d17711d23e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:14.998524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd338013-4995-4763-843c-5e16b257be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:14.999137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338013-4995-4763-843c-5e16b257be76 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:14.999443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338013-4995-4763-843c-5e16b257be76 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:14.999711 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338013-4995-4763-843c-5e16b257be76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.000440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd338013-4995-4763-843c-5e16b257be76 None admin] RBAC: Adding query filter params (interface=public, service_id=f4bb51eb2da541ab80ac44b594c7b57e, region_id=RegionOne) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:15.001061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd338013-4995-4763-843c-5e16b257be76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:15.002640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd338013-4995-4763-843c-5e16b257be76 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:15.011429 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 384/767] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Sep 3 01:10:14 2022] GET /identity/v3/endpoints?service_id=f4bb51eb2da541ab80ac44b594c7b57e&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-dcfc551d-97b9-4940-a57a-38d17711d23e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:15.012089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:15.013162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:15.014223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:15.014223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:15.014223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:15.014408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101bf6d-d64b-48e3-9e3e-da9ebf7d2fe1 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:15.014408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101bf6d-d64b-48e3-9e3e-da9ebf7d2fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:15.014408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101bf6d-d64b-48e3-9e3e-da9ebf7d2fe1 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.016813 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 384/768] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:15.019720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc551d-97b9-4940-a57a-38d17711d23e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:15.023071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 385/769] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:15.025405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101bf6d-d64b-48e3-9e3e-da9ebf7d2fe1 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:15.145620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc551d-97b9-4940-a57a-38d17711d23e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:15.171634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101bf6d-d64b-48e3-9e3e-da9ebf7d2fe1 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:15.181572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:15.186137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0502258-c03b-4647-9a3e-09afd18c3e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:15.186970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0502258-c03b-4647-9a3e-09afd18c3e05 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:15.187467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0502258-c03b-4647-9a3e-09afd18c3e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:15.187906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0502258-c03b-4647-9a3e-09afd18c3e05 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.188728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0502258-c03b-4647-9a3e-09afd18c3e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:15.190568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0502258-c03b-4647-9a3e-09afd18c3e05 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:15.202858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 385/770] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Sep 3 01:10:15 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:15.204770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827655-dccb-4e00-81e9-37ac824da2da None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:15.205048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827655-dccb-4e00-81e9-37ac824da2da None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:15.205327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827655-dccb-4e00-81e9-37ac824da2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.224502 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b91a4-0c09-4d67-b1cc-fe57d43f7eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:15.225451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b91a4-0c09-4d67-b1cc-fe57d43f7eac None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:15.225924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b91a4-0c09-4d67-b1cc-fe57d43f7eac None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:15.226407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c9827655-dccb-4e00-81e9-37ac824da2da None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:15.226617 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b91a4-0c09-4d67-b1cc-fe57d43f7eac None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.227500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b91a4-0c09-4d67-b1cc-fe57d43f7eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:15.227702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c9827655-dccb-4e00-81e9-37ac824da2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:15.228203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b91a4-0c09-4d67-b1cc-fe57d43f7eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:15.229844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b91a4-0c09-4d67-b1cc-fe57d43f7eac None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:15.244020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 386/771] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:15.245806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc196f-7ff9-4c58-8f12-820eaadb577e None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:15.246297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc196f-7ff9-4c58-8f12-820eaadb577e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:15.246774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc196f-7ff9-4c58-8f12-820eaadb577e None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.248813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 387/772] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:15.249930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc196f-7ff9-4c58-8f12-820eaadb577e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:15.269003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:15.339460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 386/773] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:15.340953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a51699-313e-42ba-9ff1-156e79161065 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:15.341230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a51699-313e-42ba-9ff1-156e79161065 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:15.341496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a51699-313e-42ba-9ff1-156e79161065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.376384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-55a51699-313e-42ba-9ff1-156e79161065 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:15.377585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-55a51699-313e-42ba-9ff1-156e79161065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:15.386801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc196f-7ff9-4c58-8f12-820eaadb577e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:15.431881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1cbc5-18ac-4f39-8f34-ea353d048634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:15.432383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1cbc5-18ac-4f39-8f34-ea353d048634 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:15.432708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1cbc5-18ac-4f39-8f34-ea353d048634 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:15.433031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1cbc5-18ac-4f39-8f34-ea353d048634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.443094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1cbc5-18ac-4f39-8f34-ea353d048634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:15.444933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1cbc5-18ac-4f39-8f34-ea353d048634 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-83e1cbc5-18ac-4f39-8f34-ea353d048634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:15.461940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:15.462877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:15.463825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:15.463825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:15.463825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:15.463825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:15.463825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:15.463825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:15.463825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:15.463825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:15.466865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 388/774] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:15.469640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1cbc5-18ac-4f39-8f34-ea353d048634 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:15.475369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 387/775] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:15.550187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:15.599556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1cbc5-18ac-4f39-8f34-ea353d048634 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:15.646598 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe5889-8557-49b0-8c1c-b055cb652f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:15.647288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe5889-8557-49b0-8c1c-b055cb652f3d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:15.647639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe5889-8557-49b0-8c1c-b055cb652f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:15.647911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe5889-8557-49b0-8c1c-b055cb652f3d None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.648613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe5889-8557-49b0-8c1c-b055cb652f3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:15.648979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe5889-8557-49b0-8c1c-b055cb652f3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:15.650428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe5889-8557-49b0-8c1c-b055cb652f3d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:15.668709 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 389/776] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:15.675629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a51699-313e-42ba-9ff1-156e79161065 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:15.782027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:15.784466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe5889-8557-49b0-8c1c-b055cb652f3d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:15.832269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a51699-313e-42ba-9ff1-156e79161065 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:15.878854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa66a0-95f6-4ed3-88e7-a9cdf8aa2a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:15.879504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa66a0-95f6-4ed3-88e7-a9cdf8aa2a8b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:15.879780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa66a0-95f6-4ed3-88e7-a9cdf8aa2a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:15.880049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa66a0-95f6-4ed3-88e7-a9cdf8aa2a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.880778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa66a0-95f6-4ed3-88e7-a9cdf8aa2a8b None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=4c5af37aaa654585817e3aad0489d323) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:15.881086 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa66a0-95f6-4ed3-88e7-a9cdf8aa2a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:15.883070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa66a0-95f6-4ed3-88e7-a9cdf8aa2a8b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:15.890470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 388/777] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:15 2022] GET /identity/v3/role_assignments?user.id=4c5af37aaa654585817e3aad0489d323&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:15.891537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa66a0-95f6-4ed3-88e7-a9cdf8aa2a8b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:15.902788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe5889-8557-49b0-8c1c-b055cb652f3d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:15.947124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:15.967994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6654-0561-492a-ad7c-07069973a370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:15.969177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6654-0561-492a-ad7c-07069973a370 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:15.972695 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6654-0561-492a-ad7c-07069973a370 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:15.973278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6654-0561-492a-ad7c-07069973a370 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:15.993975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d6654-0561-492a-ad7c-07069973a370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-cb6d6654-0561-492a-ad7c-07069973a370 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:16.005029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:16.006473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:16.007351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:16.014459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 390/778] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:16.019967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6654-0561-492a-ad7c-07069973a370 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:16.073432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa66a0-95f6-4ed3-88e7-a9cdf8aa2a8b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:16.094415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:16.129612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ce9d5-b6c8-40de-8b56-56a8d71e3d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:16.130249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ce9d5-b6c8-40de-8b56-56a8d71e3d72 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:16.130520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ce9d5-b6c8-40de-8b56-56a8d71e3d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:16.130783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ce9d5-b6c8-40de-8b56-56a8d71e3d72 None admin] PATH_INFO: `/v3/services/network` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:16.131382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ce9d5-b6c8-40de-8b56-56a8d71e3d72 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:16.132742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ce9d5-b6c8-40de-8b56-56a8d71e3d72 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1a2ce9d5-b6c8-40de-8b56-56a8d71e3d72 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:16.145034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:16.146047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 01:10:16.146871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:16.147625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 389/779] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:15 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:16.159872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ce9d5-b6c8-40de-8b56-56a8d71e3d72 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:16.207931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6654-0561-492a-ad7c-07069973a370 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:16.270862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780d0d0-f54a-49ea-abd8-8acfd2b3c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:16.271915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780d0d0-f54a-49ea-abd8-8acfd2b3c563 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:16.272430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780d0d0-f54a-49ea-abd8-8acfd2b3c563 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:16.272904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780d0d0-f54a-49ea-abd8-8acfd2b3c563 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:16.273764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780d0d0-f54a-49ea-abd8-8acfd2b3c563 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:16.274257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780d0d0-f54a-49ea-abd8-8acfd2b3c563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:16.275885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780d0d0-f54a-49ea-abd8-8acfd2b3c563 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:16.292504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 391/780] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:16.299605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780d0d0-f54a-49ea-abd8-8acfd2b3c563 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:16.300613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ce9d5-b6c8-40de-8b56-56a8d71e3d72 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:16.343300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330336e7-28d8-4a0f-bcf8-5ae9b77447ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:16.343300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330336e7-28d8-4a0f-bcf8-5ae9b77447ad None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:16.343300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330336e7-28d8-4a0f-bcf8-5ae9b77447ad None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:16.343300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330336e7-28d8-4a0f-bcf8-5ae9b77447ad None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:16.344255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330336e7-28d8-4a0f-bcf8-5ae9b77447ad None admin] RBAC: Adding query filter params (name=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:16.344255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330336e7-28d8-4a0f-bcf8-5ae9b77447ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:16.344255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330336e7-28d8-4a0f-bcf8-5ae9b77447ad None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:16.344918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 390/781] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:16.351141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330336e7-28d8-4a0f-bcf8-5ae9b77447ad None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:16.389510 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:16.410578 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:16.474850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330336e7-28d8-4a0f-bcf8-5ae9b77447ad None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:16.478432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780d0d0-f54a-49ea-abd8-8acfd2b3c563 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:16.514448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8ebef-4b1a-4270-a9dc-7b6133eeb258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:16.515852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ebef-4b1a-4270-a9dc-7b6133eeb258 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:16.516752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ebef-4b1a-4270-a9dc-7b6133eeb258 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:16.517328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ebef-4b1a-4270-a9dc-7b6133eeb258 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:16.518200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8ebef-4b1a-4270-a9dc-7b6133eeb258 None admin] RBAC: Adding query filter params (type=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:16.518701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8ebef-4b1a-4270-a9dc-7b6133eeb258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:16.520288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8ebef-4b1a-4270-a9dc-7b6133eeb258 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:16.526786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 391/782] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:16.533456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8ebef-4b1a-4270-a9dc-7b6133eeb258 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:16.561169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e68344-d7f6-48cf-a447-e7547ac99a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:16.561783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e68344-d7f6-48cf-a447-e7547ac99a3c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:16.562109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e68344-d7f6-48cf-a447-e7547ac99a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:16.562486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e68344-d7f6-48cf-a447-e7547ac99a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:16.591344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e68344-d7f6-48cf-a447-e7547ac99a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:16.592830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e68344-d7f6-48cf-a447-e7547ac99a3c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-a3e68344-d7f6-48cf-a447-e7547ac99a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:16.628801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:16.629775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:16.630663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:16.630663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:16.630663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:16.630663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 392/783] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:16.640184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e68344-d7f6-48cf-a447-e7547ac99a3c None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:16.654247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8ebef-4b1a-4270-a9dc-7b6133eeb258 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:16.687766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:16.711709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde22d2-2bef-42cd-a39f-67eac348427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:16.712242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde22d2-2bef-42cd-a39f-67eac348427f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:16.712521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde22d2-2bef-42cd-a39f-67eac348427f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:16.712793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde22d2-2bef-42cd-a39f-67eac348427f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:16.713506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde22d2-2bef-42cd-a39f-67eac348427f None admin] RBAC: Adding query filter params (interface=public, service_id=75078949506f4836ac9774687db116d1, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:16.713810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde22d2-2bef-42cd-a39f-67eac348427f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:16.715179 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde22d2-2bef-42cd-a39f-67eac348427f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:16.738234 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 392/784] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Sep 3 01:10:16 2022] GET /identity/v3/endpoints?service_id=75078949506f4836ac9774687db116d1&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:16.743650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde22d2-2bef-42cd-a39f-67eac348427f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:16.865536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e68344-d7f6-48cf-a447-e7547ac99a3c None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:16.868861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:16.908519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1055d9-e716-4d9e-98a6-d7124b44338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:16.909045 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1055d9-e716-4d9e-98a6-d7124b44338c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:16.909327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1055d9-e716-4d9e-98a6-d7124b44338c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:16.909594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1055d9-e716-4d9e-98a6-d7124b44338c None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:16.910261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1055d9-e716-4d9e-98a6-d7124b44338c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:16.910531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1055d9-e716-4d9e-98a6-d7124b44338c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:16.911931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1055d9-e716-4d9e-98a6-d7124b44338c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:16.916376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde22d2-2bef-42cd-a39f-67eac348427f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:16.924625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 393/785] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:16.925946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5b4d0-ccdb-4c21-b0af-dcb7d0917ce6 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:16.926298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5b4d0-ccdb-4c21-b0af-dcb7d0917ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:16.926574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5b4d0-ccdb-4c21-b0af-dcb7d0917ce6 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:16.932091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 394/786] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:16.932956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5b4d0-ccdb-4c21-b0af-dcb7d0917ce6 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:16.958700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe8088-e7ac-4a52-ab5c-b840d2e0ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:16.959971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe8088-e7ac-4a52-ab5c-b840d2e0ac49 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:16.960876 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe8088-e7ac-4a52-ab5c-b840d2e0ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:16.961627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe8088-e7ac-4a52-ab5c-b840d2e0ac49 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:16.962469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe8088-e7ac-4a52-ab5c-b840d2e0ac49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:16.964978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe8088-e7ac-4a52-ab5c-b840d2e0ac49 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:16.979307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 393/787] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Sep 3 01:10:16 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:16.979307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491fc0-d3b5-490d-9656-ce51a01b5e14 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:16.979307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491fc0-d3b5-490d-9656-ce51a01b5e14 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:16.979307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491fc0-d3b5-490d-9656-ce51a01b5e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:17.012586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9c491fc0-d3b5-490d-9656-ce51a01b5e14 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:17.014442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9c491fc0-d3b5-490d-9656-ce51a01b5e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:17.067376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5b4d0-ccdb-4c21-b0af-dcb7d0917ce6 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:17.079035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:17.118301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28092156-cda3-4f93-8c27-414862225725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:17.118961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28092156-cda3-4f93-8c27-414862225725 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:17.119236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28092156-cda3-4f93-8c27-414862225725 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:17.119533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28092156-cda3-4f93-8c27-414862225725 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:17.129341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28092156-cda3-4f93-8c27-414862225725 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:17.130825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28092156-cda3-4f93-8c27-414862225725 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-28092156-cda3-4f93-8c27-414862225725 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:17.150269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:17.151310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:17.152340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:17.152340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:17.152340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:17.152340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:17.152340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:17.152340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:17.152340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:17.152340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:17.152340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:10:17.152340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:17.154445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 395/788] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:17.164426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28092156-cda3-4f93-8c27-414862225725 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:17.169371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 394/789] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:17.227522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:17.345533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28092156-cda3-4f93-8c27-414862225725 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:17.386703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9da003-ee10-4d90-b652-7dfa666cec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:17.387341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9da003-ee10-4d90-b652-7dfa666cec28 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:17.387673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9da003-ee10-4d90-b652-7dfa666cec28 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:17.388035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9da003-ee10-4d90-b652-7dfa666cec28 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:17.388774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9da003-ee10-4d90-b652-7dfa666cec28 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:17.389077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9da003-ee10-4d90-b652-7dfa666cec28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:17.389727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a77b3-d385-4191-858b-5323c3614d4c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:17.390154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a77b3-d385-4191-858b-5323c3614d4c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:17.390402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a77b3-d385-4191-858b-5323c3614d4c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:17.390888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9da003-ee10-4d90-b652-7dfa666cec28 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:17.392019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 395/790] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:17.397616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf15d2e-24e3-4f69-8d3a-bcc6170d23c4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:17.397899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf15d2e-24e3-4f69-8d3a-bcc6170d23c4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:17.398170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf15d2e-24e3-4f69-8d3a-bcc6170d23c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:17.430000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 396/791] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Sep 3 01:10:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:17.430898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-daf15d2e-24e3-4f69-8d3a-bcc6170d23c4 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:17.432175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-daf15d2e-24e3-4f69-8d3a-bcc6170d23c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:17.440882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9da003-ee10-4d90-b652-7dfa666cec28 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:17.530191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 396/792] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:17.531144 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf15d2e-24e3-4f69-8d3a-bcc6170d23c4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:17.545496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:17.565338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9da003-ee10-4d90-b652-7dfa666cec28 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:17.602292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebea9f-5d4f-40ed-9b83-66a7e8977d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:17.602929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebea9f-5d4f-40ed-9b83-66a7e8977d81 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:17.603207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebea9f-5d4f-40ed-9b83-66a7e8977d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:17.603507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebea9f-5d4f-40ed-9b83-66a7e8977d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:17.614892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebea9f-5d4f-40ed-9b83-66a7e8977d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:17.616387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebea9f-5d4f-40ed-9b83-66a7e8977d81 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:17.631640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-48ebea9f-5d4f-40ed-9b83-66a7e8977d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:17.631985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:17.632904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:17.633778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:17.633778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:17.633778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:17.633778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 397/793] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:17.638403 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf15d2e-24e3-4f69-8d3a-bcc6170d23c4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:17.644268 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebea9f-5d4f-40ed-9b83-66a7e8977d81 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:17.674865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5a3b-b963-4000-a522-8986f91d88a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:17.675961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5a3b-b963-4000-a522-8986f91d88a5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:17.676297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5a3b-b963-4000-a522-8986f91d88a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:17.676636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5a3b-b963-4000-a522-8986f91d88a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:17.687866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce5a3b-b963-4000-a522-8986f91d88a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-32ce5a3b-b963-4000-a522-8986f91d88a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:17.692946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:17.693904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:17.694745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 397/794] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:17.712688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5a3b-b963-4000-a522-8986f91d88a5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:17.771453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebea9f-5d4f-40ed-9b83-66a7e8977d81 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:17.808044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09936c88-91c0-4224-89a5-ba017e26374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:17.808656 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936c88-91c0-4224-89a5-ba017e26374a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:17.808934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936c88-91c0-4224-89a5-ba017e26374a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:17.809205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936c88-91c0-4224-89a5-ba017e26374a None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:17.809846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09936c88-91c0-4224-89a5-ba017e26374a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:17.810146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09936c88-91c0-4224-89a5-ba017e26374a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:17.811550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09936c88-91c0-4224-89a5-ba017e26374a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:17.814719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:17.827941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 398/795] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:17.833307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09936c88-91c0-4224-89a5-ba017e26374a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:17.904614 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5a3b-b963-4000-a522-8986f91d88a5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:17.940294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2f9c7-6d53-4a0a-9007-972ae4738a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:17.940822 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f9c7-6d53-4a0a-9007-972ae4738a1a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:17.941101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f9c7-6d53-4a0a-9007-972ae4738a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:17.941419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f9c7-6d53-4a0a-9007-972ae4738a1a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:17.942084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2f9c7-6d53-4a0a-9007-972ae4738a1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:17.942381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2f9c7-6d53-4a0a-9007-972ae4738a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:17.943859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2f9c7-6d53-4a0a-9007-972ae4738a1a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:17.953681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 398/796] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:17.955002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2f9c7-6d53-4a0a-9007-972ae4738a1a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:17.968464 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09936c88-91c0-4224-89a5-ba017e26374a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:17.985113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:18.012636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3393d0-c012-4e58-bbc8-6b3b4a920ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:18.013271 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3393d0-c012-4e58-bbc8-6b3b4a920ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.014016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3393d0-c012-4e58-bbc8-6b3b4a920ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.014294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3393d0-c012-4e58-bbc8-6b3b4a920ec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.024147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3393d0-c012-4e58-bbc8-6b3b4a920ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:18.025608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3393d0-c012-4e58-bbc8-6b3b4a920ec4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-fa3393d0-c012-4e58-bbc8-6b3b4a920ec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:18.041350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:18.042255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:18.043151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:18.043151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:18.043151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:18.043151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:18.043151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:18.043151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:18.043151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:18.043151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:18.047343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 399/797] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:18.048272 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3393d0-c012-4e58-bbc8-6b3b4a920ec4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:18.081915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2f9c7-6d53-4a0a-9007-972ae4738a1a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:18.118497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:18.124987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97c521-4836-4f0d-8da4-710c8206b35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:18.126187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97c521-4836-4f0d-8da4-710c8206b35d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.126608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97c521-4836-4f0d-8da4-710c8206b35d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.127431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97c521-4836-4f0d-8da4-710c8206b35d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.128474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97c521-4836-4f0d-8da4-710c8206b35d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:18.130050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97c521-4836-4f0d-8da4-710c8206b35d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9b97c521-4836-4f0d-8da4-710c8206b35d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:18.142904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:18.144149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 01:10:18.145206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:18.148178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 399/798] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Sep 3 01:10:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:18.149246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97c521-4836-4f0d-8da4-710c8206b35d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:18.178539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3393d0-c012-4e58-bbc8-6b3b4a920ec4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:18.217027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371c97d-5148-49c7-9fa3-77755b176eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:18.217563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c97d-5148-49c7-9fa3-77755b176eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.217838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c97d-5148-49c7-9fa3-77755b176eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.218104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c97d-5148-49c7-9fa3-77755b176eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.228876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371c97d-5148-49c7-9fa3-77755b176eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:18.230682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371c97d-5148-49c7-9fa3-77755b176eb2 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-2371c97d-5148-49c7-9fa3-77755b176eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:18.245017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:18.246074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:18.246962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:18.246962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:18.246962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:18.246962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 400/799] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:18.246962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371c97d-5148-49c7-9fa3-77755b176eb2 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:18.271780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:18.291437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97c521-4836-4f0d-8da4-710c8206b35d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:18.328157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c099fb-54ad-4a9a-846f-c13c08be6f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:18.328975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c099fb-54ad-4a9a-846f-c13c08be6f29 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.329252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c099fb-54ad-4a9a-846f-c13c08be6f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.329520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c099fb-54ad-4a9a-846f-c13c08be6f29 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.330214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c099fb-54ad-4a9a-846f-c13c08be6f29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:18.330516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c099fb-54ad-4a9a-846f-c13c08be6f29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:18.331974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c099fb-54ad-4a9a-846f-c13c08be6f29 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:18.345188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 400/800] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:18.346218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e128eb3-0952-463d-870e-5fa22e2bdd82 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.346498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e128eb3-0952-463d-870e-5fa22e2bdd82 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.346770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e128eb3-0952-463d-870e-5fa22e2bdd82 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.348098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 401/801] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:18.352774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e128eb3-0952-463d-870e-5fa22e2bdd82 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:18.368900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371c97d-5148-49c7-9fa3-77755b176eb2 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:18.378370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:18.408081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b02f9f-ea15-46ea-8e4c-bc8b2acf0614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:18.408700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b02f9f-ea15-46ea-8e4c-bc8b2acf0614 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.408981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b02f9f-ea15-46ea-8e4c-bc8b2acf0614 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.409254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b02f9f-ea15-46ea-8e4c-bc8b2acf0614 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.409882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b02f9f-ea15-46ea-8e4c-bc8b2acf0614 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:18.410183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b02f9f-ea15-46ea-8e4c-bc8b2acf0614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:18.411607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b02f9f-ea15-46ea-8e4c-bc8b2acf0614 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:18.421350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 401/802] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Sep 3 01:10:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:18.422287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b02f9f-ea15-46ea-8e4c-bc8b2acf0614 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:18.476174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e128eb3-0952-463d-870e-5fa22e2bdd82 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:18.510035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c0eee-88d0-45f8-9b85-4ead1c7c512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:18.510647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c0eee-88d0-45f8-9b85-4ead1c7c512d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.510926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c0eee-88d0-45f8-9b85-4ead1c7c512d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.511202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c0eee-88d0-45f8-9b85-4ead1c7c512d None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.511875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c0eee-88d0-45f8-9b85-4ead1c7c512d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:18.512176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c0eee-88d0-45f8-9b85-4ead1c7c512d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:18.513537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c0eee-88d0-45f8-9b85-4ead1c7c512d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:18.524984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 402/803] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:18.526242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70737c16-0ecf-4d18-9045-f9129659e439 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.526517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70737c16-0ecf-4d18-9045-f9129659e439 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.526784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70737c16-0ecf-4d18-9045-f9129659e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.535438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:18.543514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b02f9f-ea15-46ea-8e4c-bc8b2acf0614 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:18.547702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-70737c16-0ecf-4d18-9045-f9129659e439 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:18.548905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-70737c16-0ecf-4d18-9045-f9129659e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:18.583188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef270c-852b-410d-8a4c-6ad693980438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:18.584247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef270c-852b-410d-8a4c-6ad693980438 None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.584699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef270c-852b-410d-8a4c-6ad693980438 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.585136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef270c-852b-410d-8a4c-6ad693980438 None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/4a844df7e3574911b6ea31e7d7bee715/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.587457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef270c-852b-410d-8a4c-6ad693980438 None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=4a844df7e3574911b6ea31e7d7bee715, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:18.589094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef270c-852b-410d-8a4c-6ad693980438 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:18.605736 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 402/804] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:10:18 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/4a844df7e3574911b6ea31e7d7bee715/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:10:18.606802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef270c-852b-410d-8a4c-6ad693980438 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:18.630681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 403/805] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:18.632070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70737c16-0ecf-4d18-9045-f9129659e439 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:18.681081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:18.820242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70737c16-0ecf-4d18-9045-f9129659e439 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:18.825016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef270c-852b-410d-8a4c-6ad693980438 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:18.866522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ab8d5-e4e9-420b-bbc9-9f93f02dd0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:18.867573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ab8d5-e4e9-420b-bbc9-9f93f02dd0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.868097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ab8d5-e4e9-420b-bbc9-9f93f02dd0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.868563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ab8d5-e4e9-420b-bbc9-9f93f02dd0b2 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.869391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ab8d5-e4e9-420b-bbc9-9f93f02dd0b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:18.869899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ab8d5-e4e9-420b-bbc9-9f93f02dd0b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:18.872117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ab8d5-e4e9-420b-bbc9-9f93f02dd0b2 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:18.878211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 403/806] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Sep 3 01:10:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:18.885578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ab8d5-e4e9-420b-bbc9-9f93f02dd0b2 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:18.905151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13d391-462a-43af-8a09-cbf1d99cc332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:18.905853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13d391-462a-43af-8a09-cbf1d99cc332 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:18.906167 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13d391-462a-43af-8a09-cbf1d99cc332 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:18.906442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13d391-462a-43af-8a09-cbf1d99cc332 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:18.918376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13d391-462a-43af-8a09-cbf1d99cc332 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:18.919864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13d391-462a-43af-8a09-cbf1d99cc332 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:18.923546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2d13d391-462a-43af-8a09-cbf1d99cc332 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:18.940751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:18.941785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:18.942738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 404/807] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Sep 3 01:10:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:18.943369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13d391-462a-43af-8a09-cbf1d99cc332 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:19.017723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:19.025903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ab8d5-e4e9-420b-bbc9-9f93f02dd0b2 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:19.052269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13d391-462a-43af-8a09-cbf1d99cc332 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:19.065559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8894c91-a019-4066-b162-8d5dfb92db94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:19.066692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8894c91-a019-4066-b162-8d5dfb92db94 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:19.067288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8894c91-a019-4066-b162-8d5dfb92db94 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:19.067756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8894c91-a019-4066-b162-8d5dfb92db94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:19.068621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8894c91-a019-4066-b162-8d5dfb92db94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:19.070363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8894c91-a019-4066-b162-8d5dfb92db94 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:19.090053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00e124-55f3-41cc-a1fd-de3cee6be630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:19.090704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00e124-55f3-41cc-a1fd-de3cee6be630 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:19.091021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00e124-55f3-41cc-a1fd-de3cee6be630 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:19.091362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00e124-55f3-41cc-a1fd-de3cee6be630 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:19.097424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 404/808] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:10:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:10:19.098765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8894c91-a019-4066-b162-8d5dfb92db94 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:19.104505 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00e124-55f3-41cc-a1fd-de3cee6be630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6d00e124-55f3-41cc-a1fd-de3cee6be630 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:19.111884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:19.112938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:19.113867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 405/809] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:10:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:19.119871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00e124-55f3-41cc-a1fd-de3cee6be630 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:19.197745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:19.247341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8894c91-a019-4066-b162-8d5dfb92db94 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:19.275109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00e124-55f3-41cc-a1fd-de3cee6be630 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:19.294051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0e4e0-87c9-495e-ad81-65390a6a571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:19.294776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0e4e0-87c9-495e-ad81-65390a6a571e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:19.295129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0e4e0-87c9-495e-ad81-65390a6a571e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:19.295520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0e4e0-87c9-495e-ad81-65390a6a571e None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:19.296613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0e4e0-87c9-495e-ad81-65390a6a571e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:19.297033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0e4e0-87c9-495e-ad81-65390a6a571e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:19.299036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0e4e0-87c9-495e-ad81-65390a6a571e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:19.323159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 405/810] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Sep 3 01:10:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:19.323159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321bef4-7a8e-494b-8ea3-a4a3d82327cf None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:19.323159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321bef4-7a8e-494b-8ea3-a4a3d82327cf None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:19.323159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321bef4-7a8e-494b-8ea3-a4a3d82327cf None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:19.323159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 406/811] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:19.327384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc988b9-3576-4219-9dd2-e2a8a8929989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:19.327725 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321bef4-7a8e-494b-8ea3-a4a3d82327cf None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:19.328376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc988b9-3576-4219-9dd2-e2a8a8929989 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:19.328824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc988b9-3576-4219-9dd2-e2a8a8929989 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:19.329239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc988b9-3576-4219-9dd2-e2a8a8929989 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:19.330151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc988b9-3576-4219-9dd2-e2a8a8929989 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:19.330611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc988b9-3576-4219-9dd2-e2a8a8929989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:19.332534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc988b9-3576-4219-9dd2-e2a8a8929989 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:19.333003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:19.342061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 406/812] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:10:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:19.344349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b493c4-65e8-446b-9e14-8150205e16b3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:19.344534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b493c4-65e8-446b-9e14-8150205e16b3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:19.344786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b493c4-65e8-446b-9e14-8150205e16b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:19.367898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c6b493c4-65e8-446b-9e14-8150205e16b3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:19.369307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c6b493c4-65e8-446b-9e14-8150205e16b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:19.446538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321bef4-7a8e-494b-8ea3-a4a3d82327cf None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:19.459653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 407/813] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:19.463955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b493c4-65e8-446b-9e14-8150205e16b3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:19.509447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3e6df-f131-450f-b692-9c41909c2633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:19.510070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3e6df-f131-450f-b692-9c41909c2633 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:19.510349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3e6df-f131-450f-b692-9c41909c2633 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:19.510622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3e6df-f131-450f-b692-9c41909c2633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:19.526587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:19.588533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b493c4-65e8-446b-9e14-8150205e16b3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:19.624773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5791a-8bbc-4c1d-800d-f3ff5364e8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:19.625407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5791a-8bbc-4c1d-800d-f3ff5364e8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:19.625682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5791a-8bbc-4c1d-800d-f3ff5364e8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:19.625948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5791a-8bbc-4c1d-800d-f3ff5364e8f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:19.636621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5791a-8bbc-4c1d-800d-f3ff5364e8f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:19.638678 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5791a-8bbc-4c1d-800d-f3ff5364e8f9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d6a5791a-8bbc-4c1d-800d-f3ff5364e8f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:19.654250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:19.655222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:19.656182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:19.656182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:19.656182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:19.656182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 408/814] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:19.664347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5791a-8bbc-4c1d-800d-f3ff5364e8f9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:19.684808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3e6df-f131-450f-b692-9c41909c2633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:19.686313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3e6df-f131-450f-b692-9c41909c2633 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:19.689459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:19.791862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 407/815] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:10:19.799088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3e6df-f131-450f-b692-9c41909c2633 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:19.865130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:19.869272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5791a-8bbc-4c1d-800d-f3ff5364e8f9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:19.907502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc717b9-db13-46a2-8e47-600f017bed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:19.908297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc717b9-db13-46a2-8e47-600f017bed13 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:19.908577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc717b9-db13-46a2-8e47-600f017bed13 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:19.908843 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc717b9-db13-46a2-8e47-600f017bed13 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:19.909489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc717b9-db13-46a2-8e47-600f017bed13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:19.909784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc717b9-db13-46a2-8e47-600f017bed13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:19.911402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc717b9-db13-46a2-8e47-600f017bed13 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:19.916868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3e6df-f131-450f-b692-9c41909c2633 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:19.919417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:19.925531 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 409/816] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:19.926471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc717b9-db13-46a2-8e47-600f017bed13 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:19.954419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4eb46-9fa1-4188-804e-d9ed82e825c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:19.955461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4eb46-9fa1-4188-804e-d9ed82e825c8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:19.956103 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4eb46-9fa1-4188-804e-d9ed82e825c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:19.956665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4eb46-9fa1-4188-804e-d9ed82e825c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:19.967357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4eb46-9fa1-4188-804e-d9ed82e825c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:19.969243 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4eb46-9fa1-4188-804e-d9ed82e825c8 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-47c4eb46-9fa1-4188-804e-d9ed82e825c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:19.985574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:19.986560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:19.987493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:19.987493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:19.987493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:19.994145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 408/817] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:19.995303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4eb46-9fa1-4188-804e-d9ed82e825c8 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.034610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc717b9-db13-46a2-8e47-600f017bed13 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:20.076720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b6674-ea18-400c-a3af-6bae3f902163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:20.077947 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b6674-ea18-400c-a3af-6bae3f902163 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.078227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b6674-ea18-400c-a3af-6bae3f902163 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.078495 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b6674-ea18-400c-a3af-6bae3f902163 None admin] PATH_INFO: `/v3/services/network` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.079210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b6674-ea18-400c-a3af-6bae3f902163 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:20.080768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b6674-ea18-400c-a3af-6bae3f902163 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f08b6674-ea18-400c-a3af-6bae3f902163 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:20.092117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:20.093118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 01:10:20.094147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:20.097886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 410/818] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:19 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:20.099030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b6674-ea18-400c-a3af-6bae3f902163 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.123894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:20.128654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4eb46-9fa1-4188-804e-d9ed82e825c8 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:20.173245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf611a39-a206-4311-bbda-4ba11bcad6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:20.174277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf611a39-a206-4311-bbda-4ba11bcad6fe None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.174749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf611a39-a206-4311-bbda-4ba11bcad6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.175220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf611a39-a206-4311-bbda-4ba11bcad6fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.185200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf611a39-a206-4311-bbda-4ba11bcad6fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:20.186670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf611a39-a206-4311-bbda-4ba11bcad6fe None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-cf611a39-a206-4311-bbda-4ba11bcad6fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:20.203285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:20.204397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:20.205319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 409/819] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Sep 3 01:10:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:20.205891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf611a39-a206-4311-bbda-4ba11bcad6fe None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.218015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b6674-ea18-400c-a3af-6bae3f902163 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:20.224808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:20.266836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1878818-99bf-4f16-aee4-6027b5e34bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:20.268046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878818-99bf-4f16-aee4-6027b5e34bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.268455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878818-99bf-4f16-aee4-6027b5e34bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.268850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878818-99bf-4f16-aee4-6027b5e34bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.269501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1878818-99bf-4f16-aee4-6027b5e34bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:20.269799 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1878818-99bf-4f16-aee4-6027b5e34bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:20.271648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1878818-99bf-4f16-aee4-6027b5e34bc9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:20.287441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 411/820] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:20.288341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1878818-99bf-4f16-aee4-6027b5e34bc9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.322222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf611a39-a206-4311-bbda-4ba11bcad6fe None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:20.365625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6be2a-010f-4dc7-a089-d63361a18a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:20.366519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6be2a-010f-4dc7-a089-d63361a18a8b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.366801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6be2a-010f-4dc7-a089-d63361a18a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.367694 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6be2a-010f-4dc7-a089-d63361a18a8b None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.368334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6be2a-010f-4dc7-a089-d63361a18a8b None admin] RBAC: Adding query filter params (name=network) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:20.368891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6be2a-010f-4dc7-a089-d63361a18a8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:20.370725 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6be2a-010f-4dc7-a089-d63361a18a8b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:20.383459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 410/821] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:20.384377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6be2a-010f-4dc7-a089-d63361a18a8b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.392070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:20.418353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1878818-99bf-4f16-aee4-6027b5e34bc9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:20.463863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514029b-ac06-4651-a965-37d05e65a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:20.465559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514029b-ac06-4651-a965-37d05e65a87a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.465980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514029b-ac06-4651-a965-37d05e65a87a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.466416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514029b-ac06-4651-a965-37d05e65a87a None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.467318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514029b-ac06-4651-a965-37d05e65a87a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:20.467762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514029b-ac06-4651-a965-37d05e65a87a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:20.469349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514029b-ac06-4651-a965-37d05e65a87a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:20.476524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:20.494830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 412/822] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Sep 3 01:10:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:20.496585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514029b-ac06-4651-a965-37d05e65a87a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.499715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6be2a-010f-4dc7-a089-d63361a18a8b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:20.536492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca299c-6405-4e42-87e4-decf03b6dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:20.537215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca299c-6405-4e42-87e4-decf03b6dc3a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.537565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca299c-6405-4e42-87e4-decf03b6dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.537906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca299c-6405-4e42-87e4-decf03b6dc3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.546143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca299c-6405-4e42-87e4-decf03b6dc3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:20.547608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca299c-6405-4e42-87e4-decf03b6dc3a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-50ca299c-6405-4e42-87e4-decf03b6dc3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:20.560852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:20.561976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:20.563305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:20.563305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:20.563305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:20.563305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:20.563305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:20.563305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:20.563305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:20.563305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:20.567337 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 411/823] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:20.568459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca299c-6405-4e42-87e4-decf03b6dc3a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.627266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514029b-ac06-4651-a965-37d05e65a87a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:20.674263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f053c-ba78-4674-9362-098d6ed69b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:20.675111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f053c-ba78-4674-9362-098d6ed69b96 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.675557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f053c-ba78-4674-9362-098d6ed69b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.675993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f053c-ba78-4674-9362-098d6ed69b96 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.677311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f053c-ba78-4674-9362-098d6ed69b96 None admin] RBAC: Adding query filter params (type=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:20.678019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f053c-ba78-4674-9362-098d6ed69b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:20.680184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f053c-ba78-4674-9362-098d6ed69b96 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:20.692794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca299c-6405-4e42-87e4-decf03b6dc3a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:20.692969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 413/824] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:20.692969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f053c-ba78-4674-9362-098d6ed69b96 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.697601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:20.736892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61674b94-3156-4d25-bd96-d18d0a6cf8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:20.737542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61674b94-3156-4d25-bd96-d18d0a6cf8ca None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.737821 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61674b94-3156-4d25-bd96-d18d0a6cf8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.738094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61674b94-3156-4d25-bd96-d18d0a6cf8ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.748051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:20.750472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61674b94-3156-4d25-bd96-d18d0a6cf8ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:20.752060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61674b94-3156-4d25-bd96-d18d0a6cf8ca None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-61674b94-3156-4d25-bd96-d18d0a6cf8ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:20.767087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:20.768115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:20.769015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:20.769015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:20.769015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:20.769015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 412/825] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:20.769015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61674b94-3156-4d25-bd96-d18d0a6cf8ca None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.800425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f053c-ba78-4674-9362-098d6ed69b96 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:20.836120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58002d87-6320-4fee-af50-563856d53955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:20.836877 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58002d87-6320-4fee-af50-563856d53955 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.836985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58002d87-6320-4fee-af50-563856d53955 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.837265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58002d87-6320-4fee-af50-563856d53955 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.837994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58002d87-6320-4fee-af50-563856d53955 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:20.838330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58002d87-6320-4fee-af50-563856d53955 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:20.839856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58002d87-6320-4fee-af50-563856d53955 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:20.857589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 414/826] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:20.857589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcf4b5-f9b4-4ec4-ab37-cc97bd98c2e8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.857589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcf4b5-f9b4-4ec4-ab37-cc97bd98c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.857589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcf4b5-f9b4-4ec4-ab37-cc97bd98c2e8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.857589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 415/827] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:20.857589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcf4b5-f9b4-4ec4-ab37-cc97bd98c2e8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.879642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61674b94-3156-4d25-bd96-d18d0a6cf8ca None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:20.914634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa69ca-0290-43a1-aba0-07e67fe3255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:20.915241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa69ca-0290-43a1-aba0-07e67fe3255d None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:20.915544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa69ca-0290-43a1-aba0-07e67fe3255d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:20.915805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa69ca-0290-43a1-aba0-07e67fe3255d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:20.916470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa69ca-0290-43a1-aba0-07e67fe3255d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:20.917849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa69ca-0290-43a1-aba0-07e67fe3255d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:20.930262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:20.942276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 413/828] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:10:20 2022] POST /identity/v3/endpoints => generated 337 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:20.943364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa69ca-0290-43a1-aba0-07e67fe3255d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:20.994211 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcf4b5-f9b4-4ec4-ab37-cc97bd98c2e8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:21.019854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:21.044443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631188d0-d2db-47a2-a960-d9e12176cd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:21.045114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631188d0-d2db-47a2-a960-d9e12176cd87 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.045395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631188d0-d2db-47a2-a960-d9e12176cd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.045663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631188d0-d2db-47a2-a960-d9e12176cd87 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.047809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631188d0-d2db-47a2-a960-d9e12176cd87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:21.048261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631188d0-d2db-47a2-a960-d9e12176cd87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:21.049957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631188d0-d2db-47a2-a960-d9e12176cd87 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:21.090713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa69ca-0290-43a1-aba0-07e67fe3255d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:21.134416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ff92-e3f9-4904-8386-b94c8a3e711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:21.135045 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ff92-e3f9-4904-8386-b94c8a3e711b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.135350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ff92-e3f9-4904-8386-b94c8a3e711b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.135623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ff92-e3f9-4904-8386-b94c8a3e711b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.136371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559ff92-e3f9-4904-8386-b94c8a3e711b None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=9c4076fd5abc4b508a0215ce22af85d6) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:21.136677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559ff92-e3f9-4904-8386-b94c8a3e711b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:21.138165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559ff92-e3f9-4904-8386-b94c8a3e711b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:21.146011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 414/829] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:20 2022] GET /identity/v3/role_assignments?user.id=9c4076fd5abc4b508a0215ce22af85d6&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:21.148234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9baf4-f7bf-439e-8865-6d92dad76ade None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.148343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9baf4-f7bf-439e-8865-6d92dad76ade None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.148562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9baf4-f7bf-439e-8865-6d92dad76ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.169709 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f9d9baf4-f7bf-439e-8865-6d92dad76ade None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:21.170926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f9d9baf4-f7bf-439e-8865-6d92dad76ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:21.197166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 416/830] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:21.203183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631188d0-d2db-47a2-a960-d9e12176cd87 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:21.302789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 415/831] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:21.304012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d416-b984-47f0-b487-10be52c00271 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.304296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d416-b984-47f0-b487-10be52c00271 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.304573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d416-b984-47f0-b487-10be52c00271 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.310484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 416/832] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:21.311889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554b3d2-a149-4f44-b849-93b5fa9f9aee None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.312216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554b3d2-a149-4f44-b849-93b5fa9f9aee None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.312493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554b3d2-a149-4f44-b849-93b5fa9f9aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.327523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631188d0-d2db-47a2-a960-d9e12176cd87 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:21.337691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2554b3d2-a149-4f44-b849-93b5fa9f9aee None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:21.338904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2554b3d2-a149-4f44-b849-93b5fa9f9aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:21.357125 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:21.374899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf27dc2-d8a9-452f-9bc6-8d41e8b9990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:21.376043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf27dc2-d8a9-452f-9bc6-8d41e8b9990e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.376043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf27dc2-d8a9-452f-9bc6-8d41e8b9990e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.376208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf27dc2-d8a9-452f-9bc6-8d41e8b9990e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.382958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf27dc2-d8a9-452f-9bc6-8d41e8b9990e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:21.384463 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf27dc2-d8a9-452f-9bc6-8d41e8b9990e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:21.386188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4bf27dc2-d8a9-452f-9bc6-8d41e8b9990e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:21.400608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:21.401553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:21.402445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:21.402445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:21.402445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:21.402445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:21.402445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:21.402445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:21.402445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:21.402445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:21.402869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 417/833] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:21.409417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf27dc2-d8a9-452f-9bc6-8d41e8b9990e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:21.432253 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 417/834] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:21.519807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf27dc2-d8a9-452f-9bc6-8d41e8b9990e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:21.555300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfe906-9337-4c15-9f24-60a93f1ba2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:21.556233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfe906-9337-4c15-9f24-60a93f1ba2ad None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.556652 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfe906-9337-4c15-9f24-60a93f1ba2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.557117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfe906-9337-4c15-9f24-60a93f1ba2ad None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.558020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfe906-9337-4c15-9f24-60a93f1ba2ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:21.558475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfe906-9337-4c15-9f24-60a93f1ba2ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:21.560280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfe906-9337-4c15-9f24-60a93f1ba2ad None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:21.573589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 418/835] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:21.579612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554b3d2-a149-4f44-b849-93b5fa9f9aee None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:21.580661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfe906-9337-4c15-9f24-60a93f1ba2ad None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:21.627123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:21.695551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfe906-9337-4c15-9f24-60a93f1ba2ad None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:21.706488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554b3d2-a149-4f44-b849-93b5fa9f9aee None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:21.738490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aee9e4-011b-4efb-bd3b-17bc8690e69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:21.739169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee9e4-011b-4efb-bd3b-17bc8690e69c None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.739486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee9e4-011b-4efb-bd3b-17bc8690e69c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.739984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee9e4-011b-4efb-bd3b-17bc8690e69c None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/4c5af37aaa654585817e3aad0489d323/roles/76b5fcb0eb664fb2b2812e427e7f9390` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.747326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52424ab6-2f91-4126-8008-9e5dfcdb59a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:21.747971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52424ab6-2f91-4126-8008-9e5dfcdb59a3 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.748250 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52424ab6-2f91-4126-8008-9e5dfcdb59a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.748519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52424ab6-2f91-4126-8008-9e5dfcdb59a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.755796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aee9e4-011b-4efb-bd3b-17bc8690e69c None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=4c5af37aaa654585817e3aad0489d323, role_id=76b5fcb0eb664fb2b2812e427e7f9390)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:21.757236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aee9e4-011b-4efb-bd3b-17bc8690e69c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:21.758862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52424ab6-2f91-4126-8008-9e5dfcdb59a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-52424ab6-2f91-4126-8008-9e5dfcdb59a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:21.763727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:21.767576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 418/836] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:21.768528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52424ab6-2f91-4126-8008-9e5dfcdb59a3 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:21.773891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 419/837] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:10:21 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/4c5af37aaa654585817e3aad0489d323/roles/76b5fcb0eb664fb2b2812e427e7f9390 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:10:21.774920 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aee9e4-011b-4efb-bd3b-17bc8690e69c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:21.810605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:21.891011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52424ab6-2f91-4126-8008-9e5dfcdb59a3 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:21.913512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:21.933658 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aee9e4-011b-4efb-bd3b-17bc8690e69c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:21.935344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649d86e-b0c3-43ea-8635-2d04e4f0e9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:21.935992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d86e-b0c3-43ea-8635-2d04e4f0e9fb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.936272 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d86e-b0c3-43ea-8635-2d04e4f0e9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.936546 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d86e-b0c3-43ea-8635-2d04e4f0e9fb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.937163 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649d86e-b0c3-43ea-8635-2d04e4f0e9fb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:21.938560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649d86e-b0c3-43ea-8635-2d04e4f0e9fb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-e649d86e-b0c3-43ea-8635-2d04e4f0e9fb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:21.951383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:21.952385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 01:10:21.953364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:21.956170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 419/838] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:10:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:21.960535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649d86e-b0c3-43ea-8635-2d04e4f0e9fb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:21.979124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206deb5c-13d4-4fdb-a5bb-70620c2bf94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:21.979780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206deb5c-13d4-4fdb-a5bb-70620c2bf94b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:21.980060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206deb5c-13d4-4fdb-a5bb-70620c2bf94b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:21.980678 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206deb5c-13d4-4fdb-a5bb-70620c2bf94b None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:21.981348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206deb5c-13d4-4fdb-a5bb-70620c2bf94b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:21.981647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206deb5c-13d4-4fdb-a5bb-70620c2bf94b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:21.983009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206deb5c-13d4-4fdb-a5bb-70620c2bf94b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:21.993469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 420/839] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:21.999645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206deb5c-13d4-4fdb-a5bb-70620c2bf94b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:22.088538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:22.095422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649d86e-b0c3-43ea-8635-2d04e4f0e9fb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:22.119765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206deb5c-13d4-4fdb-a5bb-70620c2bf94b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:22.132119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81410400-a248-4895-b077-aeab8741c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:22.132650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81410400-a248-4895-b077-aeab8741c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:22.133030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81410400-a248-4895-b077-aeab8741c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:22.133422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81410400-a248-4895-b077-aeab8741c6f9 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:22.134155 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81410400-a248-4895-b077-aeab8741c6f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:22.134554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81410400-a248-4895-b077-aeab8741c6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:22.136063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81410400-a248-4895-b077-aeab8741c6f9 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:22.141255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 420/840] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:10:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:22.148236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81410400-a248-4895-b077-aeab8741c6f9 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:22.158860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4585b-65b0-4fac-bc0c-a5b374e2e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:22.159798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4585b-65b0-4fac-bc0c-a5b374e2e769 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:22.160257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4585b-65b0-4fac-bc0c-a5b374e2e769 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:22.160676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4585b-65b0-4fac-bc0c-a5b374e2e769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:22.172288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4585b-65b0-4fac-bc0c-a5b374e2e769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:22.174067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4585b-65b0-4fac-bc0c-a5b374e2e769 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b3b4585b-65b0-4fac-bc0c-a5b374e2e769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:22.190225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:22.191391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:22.192475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:22.192475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:22.192475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:22.198991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 421/841] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:22.200238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4585b-65b0-4fac-bc0c-a5b374e2e769 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:22.205427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:22.278046 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81410400-a248-4895-b077-aeab8741c6f9 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:22.312631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334f8ae-6a50-4bda-b5b2-b1097d87d17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:22.313299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334f8ae-6a50-4bda-b5b2-b1097d87d17b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:22.313576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334f8ae-6a50-4bda-b5b2-b1097d87d17b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:22.313844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334f8ae-6a50-4bda-b5b2-b1097d87d17b None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:22.314469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334f8ae-6a50-4bda-b5b2-b1097d87d17b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:22.314765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334f8ae-6a50-4bda-b5b2-b1097d87d17b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:22.316173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334f8ae-6a50-4bda-b5b2-b1097d87d17b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:22.321151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 421/842] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:10:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:22.323846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4585b-65b0-4fac-bc0c-a5b374e2e769 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:22.368814 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b155b-1f61-4aa0-a377-e14bfc1152c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:22.369817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b155b-1f61-4aa0-a377-e14bfc1152c3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:22.370303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b155b-1f61-4aa0-a377-e14bfc1152c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:22.370807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b155b-1f61-4aa0-a377-e14bfc1152c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:22.371729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b155b-1f61-4aa0-a377-e14bfc1152c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:22.372207 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b155b-1f61-4aa0-a377-e14bfc1152c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:22.373785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b155b-1f61-4aa0-a377-e14bfc1152c3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:22.389143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 422/843] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:22.399305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334f8ae-6a50-4bda-b5b2-b1097d87d17b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:22.423717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:22.504426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334f8ae-6a50-4bda-b5b2-b1097d87d17b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:22.540329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc245a9b-a14a-4060-857b-31db4c5f3dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:22.541197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc245a9b-a14a-4060-857b-31db4c5f3dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:22.541637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc245a9b-a14a-4060-857b-31db4c5f3dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:22.542043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc245a9b-a14a-4060-857b-31db4c5f3dc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:22.549810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc245a9b-a14a-4060-857b-31db4c5f3dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:22.551440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc245a9b-a14a-4060-857b-31db4c5f3dc3 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-cc245a9b-a14a-4060-857b-31db4c5f3dc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:22.563487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:22.564751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:22.565970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:22.565970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:22.565970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:22.565970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:22.565970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:22.565970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:22.565970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:22.565970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:22.565970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 01:10:22.565970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:22.568132 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 422/844] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:22.574159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b155b-1f61-4aa0-a377-e14bfc1152c3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:22.638774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:22.677534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b155b-1f61-4aa0-a377-e14bfc1152c3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:22.713949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f848e-2fc5-4221-a0ee-0a4a13f94da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:22.715245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f848e-2fc5-4221-a0ee-0a4a13f94da7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:22.715682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f848e-2fc5-4221-a0ee-0a4a13f94da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:22.716087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f848e-2fc5-4221-a0ee-0a4a13f94da7 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:22.716956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f848e-2fc5-4221-a0ee-0a4a13f94da7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:22.717415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f848e-2fc5-4221-a0ee-0a4a13f94da7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:22.718998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f848e-2fc5-4221-a0ee-0a4a13f94da7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:22.738186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 423/845] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Sep 3 01:10:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:22.744099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc245a9b-a14a-4060-857b-31db4c5f3dc3 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:22.834074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:22.851890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc245a9b-a14a-4060-857b-31db4c5f3dc3 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:22.887107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46afdc4-5609-409a-add7-17b97c703d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:22.887757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46afdc4-5609-409a-add7-17b97c703d14 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:22.888032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46afdc4-5609-409a-add7-17b97c703d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:22.888383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46afdc4-5609-409a-add7-17b97c703d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:22.962039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46afdc4-5609-409a-add7-17b97c703d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:22.963973 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46afdc4-5609-409a-add7-17b97c703d14 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:23.051163 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:23.069837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 423/846] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:10:23.075445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f848e-2fc5-4221-a0ee-0a4a13f94da7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:23.175105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f848e-2fc5-4221-a0ee-0a4a13f94da7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:23.203958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:23.208906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dc922-2ca0-4849-8b02-7ed4ac9abc51 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.209192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dc922-2ca0-4849-8b02-7ed4ac9abc51 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.209509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dc922-2ca0-4849-8b02-7ed4ac9abc51 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.210168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d48f56-1323-42f2-9027-0209a906728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:23.210802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d48f56-1323-42f2-9027-0209a906728c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.211059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 424/847] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:23.211159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d48f56-1323-42f2-9027-0209a906728c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.211429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d48f56-1323-42f2-9027-0209a906728c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.216219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17f735-28bc-4f94-83ac-a43bea89685d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.216502 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17f735-28bc-4f94-83ac-a43bea89685d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.216773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17f735-28bc-4f94-83ac-a43bea89685d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.222738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d48f56-1323-42f2-9027-0209a906728c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:23.224662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d48f56-1323-42f2-9027-0209a906728c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:23.235703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-bd17f735-28bc-4f94-83ac-a43bea89685d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:23.236897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bd17f735-28bc-4f94-83ac-a43bea89685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-65d48f56-1323-42f2-9027-0209a906728c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:23.241025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:23.241930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:23.243003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:23.243003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:23.243003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:23.243003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 424/848] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:23.248037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d48f56-1323-42f2-9027-0209a906728c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:23.327374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 425/849] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:23.367491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d48f56-1323-42f2-9027-0209a906728c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:23.401814 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf1aa0-069a-4876-b524-c632cd022f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:23.402419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf1aa0-069a-4876-b524-c632cd022f4f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.402692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf1aa0-069a-4876-b524-c632cd022f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.402958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf1aa0-069a-4876-b524-c632cd022f4f None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.403624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf1aa0-069a-4876-b524-c632cd022f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:23.403916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf1aa0-069a-4876-b524-c632cd022f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:23.405258 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf1aa0-069a-4876-b524-c632cd022f4f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:23.418038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 425/850] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:23.424046 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17f735-28bc-4f94-83ac-a43bea89685d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:23.527571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17f735-28bc-4f94-83ac-a43bea89685d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:23.543511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:23.565719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120dc52-78ba-4796-b2f5-e567ce641422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:23.566355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120dc52-78ba-4796-b2f5-e567ce641422 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.566660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120dc52-78ba-4796-b2f5-e567ce641422 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.566991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120dc52-78ba-4796-b2f5-e567ce641422 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.573988 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120dc52-78ba-4796-b2f5-e567ce641422 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:23.575467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120dc52-78ba-4796-b2f5-e567ce641422 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:23.586058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf1aa0-069a-4876-b524-c632cd022f4f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-d120dc52-78ba-4796-b2f5-e567ce641422 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:23.587532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:23.588627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:23.589780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:23.589780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:23.589780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:23.589780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:23.589780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:23.589780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:23.589780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:23.589780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:23.589780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 426/851] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:23.594889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120dc52-78ba-4796-b2f5-e567ce641422 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:23.623771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:23.695833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120dc52-78ba-4796-b2f5-e567ce641422 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:23.696483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf1aa0-069a-4876-b524-c632cd022f4f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:23.731752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d80c-17f7-4147-b8da-ad85eba0cd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:23.732725 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762e92-643b-450f-8399-e1e0559606cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:23.733179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d80c-17f7-4147-b8da-ad85eba0cd90 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.733390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d80c-17f7-4147-b8da-ad85eba0cd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.733895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d80c-17f7-4147-b8da-ad85eba0cd90 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.734486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762e92-643b-450f-8399-e1e0559606cc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.734954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762e92-643b-450f-8399-e1e0559606cc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.735159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3d80c-17f7-4147-b8da-ad85eba0cd90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:23.735639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762e92-643b-450f-8399-e1e0559606cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.735753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3d80c-17f7-4147-b8da-ad85eba0cd90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:23.736537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb762e92-643b-450f-8399-e1e0559606cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:23.738067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb762e92-643b-450f-8399-e1e0559606cc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:23.738400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3d80c-17f7-4147-b8da-ad85eba0cd90 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-cb762e92-643b-450f-8399-e1e0559606cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:23.747842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:23.748819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 01:10:23.749802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:23.757192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 427/853] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:23.757578 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 426/853] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Sep 3 01:10:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:23.758028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d80c-17f7-4147-b8da-ad85eba0cd90 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:23.758905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762e92-643b-450f-8399-e1e0559606cc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:23.815762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:23.859240 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d80c-17f7-4147-b8da-ad85eba0cd90 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:23.859786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:23.864060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762e92-643b-450f-8399-e1e0559606cc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:23.895016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda07199-08ee-43c5-8e31-2d171ee770cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:23.895647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda07199-08ee-43c5-8e31-2d171ee770cb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.895924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda07199-08ee-43c5-8e31-2d171ee770cb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.896195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda07199-08ee-43c5-8e31-2d171ee770cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.896914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda07199-08ee-43c5-8e31-2d171ee770cb None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=4a844df7e3574911b6ea31e7d7bee715) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:23.897214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda07199-08ee-43c5-8e31-2d171ee770cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:23.898222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab3de7-728e-4cc8-bbf3-e4969d8ee266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:23.898636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda07199-08ee-43c5-8e31-2d171ee770cb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:23.898828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab3de7-728e-4cc8-bbf3-e4969d8ee266 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.899103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab3de7-728e-4cc8-bbf3-e4969d8ee266 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.899415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab3de7-728e-4cc8-bbf3-e4969d8ee266 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.900042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab3de7-728e-4cc8-bbf3-e4969d8ee266 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:23.900346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab3de7-728e-4cc8-bbf3-e4969d8ee266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:23.901671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab3de7-728e-4cc8-bbf3-e4969d8ee266 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:23.904646 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 428/854] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:23 2022] GET /identity/v3/role_assignments?user.id=4a844df7e3574911b6ea31e7d7bee715&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:23.911803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 427/855] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:23.912026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc660a-2fad-4255-95ed-fc80bb03bb9e None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.912026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc660a-2fad-4255-95ed-fc80bb03bb9e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.912026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc660a-2fad-4255-95ed-fc80bb03bb9e None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.912026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 429/856] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:23.916356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc660a-2fad-4255-95ed-fc80bb03bb9e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:23.916678 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181c2ce-c023-4873-a996-7ab41aad184c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:23.917092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181c2ce-c023-4873-a996-7ab41aad184c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:23.917492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181c2ce-c023-4873-a996-7ab41aad184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:23.940257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e181c2ce-c023-4873-a996-7ab41aad184c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:23.941901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e181c2ce-c023-4873-a996-7ab41aad184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:24.027653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 428/857] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:24.055478 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:24.061545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc660a-2fad-4255-95ed-fc80bb03bb9e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:24.098175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997d342-efed-4caa-be5b-66d8d7e6069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:24.099066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997d342-efed-4caa-be5b-66d8d7e6069a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:24.099577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997d342-efed-4caa-be5b-66d8d7e6069a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:24.100003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997d342-efed-4caa-be5b-66d8d7e6069a None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:24.100775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997d342-efed-4caa-be5b-66d8d7e6069a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:24.101273 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997d342-efed-4caa-be5b-66d8d7e6069a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:24.102824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997d342-efed-4caa-be5b-66d8d7e6069a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:24.108422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 430/858] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:24.308092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181c2ce-c023-4873-a996-7ab41aad184c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:24.380253 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b9b7-5ace-41c0-be38-f04476e46b8f None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:24.380433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b9b7-5ace-41c0-be38-f04476e46b8f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:24.380704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b9b7-5ace-41c0-be38-f04476e46b8f None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:24.383286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 431/859] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:24.387205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510c45a-ac8d-4823-b507-c7e96f891faf None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:24.387519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510c45a-ac8d-4823-b507-c7e96f891faf None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:24.387789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510c45a-ac8d-4823-b507-c7e96f891faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:24.407060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:24.407848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0510c45a-ac8d-4823-b507-c7e96f891faf None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:24.409178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0510c45a-ac8d-4823-b507-c7e96f891faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:24.418182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181c2ce-c023-4873-a996-7ab41aad184c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:24.462851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ae443-8269-4114-8fbe-99287fcd69ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:24.463575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae443-8269-4114-8fbe-99287fcd69ae None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:24.464303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae443-8269-4114-8fbe-99287fcd69ae None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:24.464595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae443-8269-4114-8fbe-99287fcd69ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:24.477883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ae443-8269-4114-8fbe-99287fcd69ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-407ae443-8269-4114-8fbe-99287fcd69ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:24.484831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:24.485767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:10:24.486609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:24.487279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 429/860] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:10:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:24.492358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ae443-8269-4114-8fbe-99287fcd69ae None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:24.499355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 432/861] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:10:24.611224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ae443-8269-4114-8fbe-99287fcd69ae None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:24.650993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb9d8a-bfd3-4712-a74f-b93f95129da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:24.651667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9d8a-bfd3-4712-a74f-b93f95129da1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:24.651951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9d8a-bfd3-4712-a74f-b93f95129da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:24.652224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9d8a-bfd3-4712-a74f-b93f95129da1 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:24.652893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb9d8a-bfd3-4712-a74f-b93f95129da1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:24.653309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb9d8a-bfd3-4712-a74f-b93f95129da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:24.654730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb9d8a-bfd3-4712-a74f-b93f95129da1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:24.664252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 430/862] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:10:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:24.669827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510c45a-ac8d-4823-b507-c7e96f891faf None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:24.770455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:24.776635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb9d8a-bfd3-4712-a74f-b93f95129da1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:24.788612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510c45a-ac8d-4823-b507-c7e96f891faf None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:24.797449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:24.829367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd218ec7-9039-4a61-b636-afb825710976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:24.830269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd218ec7-9039-4a61-b636-afb825710976 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:24.830803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd218ec7-9039-4a61-b636-afb825710976 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:24.831074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd218ec7-9039-4a61-b636-afb825710976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:24.842415 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd218ec7-9039-4a61-b636-afb825710976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:24.844087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd218ec7-9039-4a61-b636-afb825710976 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-fd218ec7-9039-4a61-b636-afb825710976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:24.862367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:24.864172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:24.865796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:24.865796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:24.865796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:24.865796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 433/863] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:24.869180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd218ec7-9039-4a61-b636-afb825710976 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:24.934315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb9d8a-bfd3-4712-a74f-b93f95129da1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:24.983491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b7795-709a-4dce-829b-334208cd0205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:24.984401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b7795-709a-4dce-829b-334208cd0205 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:24.984676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b7795-709a-4dce-829b-334208cd0205 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:24.984945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b7795-709a-4dce-829b-334208cd0205 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:24.985623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b7795-709a-4dce-829b-334208cd0205 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:24.986992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b7795-709a-4dce-829b-334208cd0205 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:25.020052 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 431/864] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:10:24 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:25.029804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd218ec7-9039-4a61-b636-afb825710976 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:25.083423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbffee-43e7-4207-b218-ab424d907461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:25.084437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbffee-43e7-4207-b218-ab424d907461 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:25.084920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbffee-43e7-4207-b218-ab424d907461 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:25.085396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbffee-43e7-4207-b218-ab424d907461 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:25.086346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbffee-43e7-4207-b218-ab424d907461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:25.086908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbffee-43e7-4207-b218-ab424d907461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:25.088696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbffee-43e7-4207-b218-ab424d907461 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:25.099655 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:25.103681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 434/865] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:25.111436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b7795-709a-4dce-829b-334208cd0205 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:25.219155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:25.245657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b7795-709a-4dce-829b-334208cd0205 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:25.282953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86868f-2285-42f3-9ab9-f7e517777c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:25.283630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86868f-2285-42f3-9ab9-f7e517777c30 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:25.283912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86868f-2285-42f3-9ab9-f7e517777c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:25.284186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86868f-2285-42f3-9ab9-f7e517777c30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:25.292340 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86868f-2285-42f3-9ab9-f7e517777c30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:25.293794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86868f-2285-42f3-9ab9-f7e517777c30 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9b86868f-2285-42f3-9ab9-f7e517777c30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:25.305856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:25.307513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:25.309183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 432/866] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Sep 3 01:10:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:25.320482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbffee-43e7-4207-b218-ab424d907461 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:25.433839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbffee-43e7-4207-b218-ab424d907461 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:25.481609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28890c53-81d7-49ab-b791-06925a575ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:25.482146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28890c53-81d7-49ab-b791-06925a575ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:25.482422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28890c53-81d7-49ab-b791-06925a575ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:25.482687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28890c53-81d7-49ab-b791-06925a575ab3 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:25.483448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28890c53-81d7-49ab-b791-06925a575ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:25.483773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28890c53-81d7-49ab-b791-06925a575ab3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:25.485637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28890c53-81d7-49ab-b791-06925a575ab3 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:25.513219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 435/867] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Sep 3 01:10:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:25.520353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86868f-2285-42f3-9ab9-f7e517777c30 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:25.635913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86868f-2285-42f3-9ab9-f7e517777c30 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:25.674486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd2e74-1cf3-45c9-aa31-dd6ee097b726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:25.675118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd2e74-1cf3-45c9-aa31-dd6ee097b726 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:25.675423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd2e74-1cf3-45c9-aa31-dd6ee097b726 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:25.675696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd2e74-1cf3-45c9-aa31-dd6ee097b726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:25.678497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:25.758890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd2e74-1cf3-45c9-aa31-dd6ee097b726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:25.760286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd2e74-1cf3-45c9-aa31-dd6ee097b726 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:25.866301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 433/868] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:25 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:10:25.876547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28890c53-81d7-49ab-b791-06925a575ab3 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:25.946813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:25.995800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28890c53-81d7-49ab-b791-06925a575ab3 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:26.031753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cbcca-95db-4d04-85c2-be0ab672467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:26.032380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cbcca-95db-4d04-85c2-be0ab672467d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.032666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cbcca-95db-4d04-85c2-be0ab672467d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.032943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cbcca-95db-4d04-85c2-be0ab672467d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.044307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cbcca-95db-4d04-85c2-be0ab672467d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:26.045804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cbcca-95db-4d04-85c2-be0ab672467d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-ae6cbcca-95db-4d04-85c2-be0ab672467d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:26.062087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:26.063117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:26.064056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:26.064056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:26.064056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:26.064056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 436/869] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:26.073469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd2e74-1cf3-45c9-aa31-dd6ee097b726 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:26.111349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:26.142983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede15642-3a03-45ea-a7c7-a635bbc62fbc None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.143347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede15642-3a03-45ea-a7c7-a635bbc62fbc None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.143580 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede15642-3a03-45ea-a7c7-a635bbc62fbc None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.145294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 437/870] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:26.151235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1cf96-7ffa-4f8b-85ff-a14d5c05c1ca None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.151551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1cf96-7ffa-4f8b-85ff-a14d5c05c1ca None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.151825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1cf96-7ffa-4f8b-85ff-a14d5c05c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.171529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-35e1cf96-7ffa-4f8b-85ff-a14d5c05c1ca None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:26.172822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-35e1cf96-7ffa-4f8b-85ff-a14d5c05c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:26.194707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd2e74-1cf3-45c9-aa31-dd6ee097b726 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:26.240944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e57c-3697-4c97-9cf0-39f07eb4d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:26.241944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e57c-3697-4c97-9cf0-39f07eb4d45c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.242426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e57c-3697-4c97-9cf0-39f07eb4d45c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.242887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e57c-3697-4c97-9cf0-39f07eb4d45c None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.244500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949e57c-3697-4c97-9cf0-39f07eb4d45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:26.245026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949e57c-3697-4c97-9cf0-39f07eb4d45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:26.246988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949e57c-3697-4c97-9cf0-39f07eb4d45c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:26.249381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 438/871] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:10:26.255792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1485a95-be64-4ae4-be4d-b450fb5d2c1c None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.256422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1485a95-be64-4ae4-be4d-b450fb5d2c1c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.256907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1485a95-be64-4ae4-be4d-b450fb5d2c1c None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.258375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 439/872] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:26.263707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a78cde-92eb-4bd5-b9e1-e52c5c80614b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.264208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 434/873] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:26.264487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a78cde-92eb-4bd5-b9e1-e52c5c80614b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.265033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a78cde-92eb-4bd5-b9e1-e52c5c80614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.265150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e57c-3697-4c97-9cf0-39f07eb4d45c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:26.285242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-24a78cde-92eb-4bd5-b9e1-e52c5c80614b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:26.286865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-24a78cde-92eb-4bd5-b9e1-e52c5c80614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:26.323981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:26.367603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 440/874] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:26.368289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:26.375693 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e57c-3697-4c97-9cf0-39f07eb4d45c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:26.412401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c0529-6f1e-45b8-a619-4bd373e1cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:26.413198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c0529-6f1e-45b8-a619-4bd373e1cdaf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.413570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c0529-6f1e-45b8-a619-4bd373e1cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.413932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c0529-6f1e-45b8-a619-4bd373e1cdaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.420799 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c0529-6f1e-45b8-a619-4bd373e1cdaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:26.422768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c0529-6f1e-45b8-a619-4bd373e1cdaf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7f0c0529-6f1e-45b8-a619-4bd373e1cdaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:26.434345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:26.435544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:26.436661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:26.436661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:26.436661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:26.436661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:26.436661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:26.436661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:26.436661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:26.436661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:26.438417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 435/875] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:26.444184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a78cde-92eb-4bd5-b9e1-e52c5c80614b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:26.512452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c0529-6f1e-45b8-a619-4bd373e1cdaf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:26.555126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a78cde-92eb-4bd5-b9e1-e52c5c80614b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:26.598123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f50f-a167-4ad3-b801-59069715c152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:26.598920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f50f-a167-4ad3-b801-59069715c152 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.599326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f50f-a167-4ad3-b801-59069715c152 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.600141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f50f-a167-4ad3-b801-59069715c152 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.600949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f50f-a167-4ad3-b801-59069715c152 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:26.601731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f50f-a167-4ad3-b801-59069715c152 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:26.603623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f50f-a167-4ad3-b801-59069715c152 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:26.623047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 441/876] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:26.624126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f50f-a167-4ad3-b801-59069715c152 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:26.627717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c0529-6f1e-45b8-a619-4bd373e1cdaf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:26.660488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:26.669898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23d6fc-1e41-4b1d-8050-bd70130ce2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:26.670859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23d6fc-1e41-4b1d-8050-bd70130ce2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.671454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23d6fc-1e41-4b1d-8050-bd70130ce2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.672186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23d6fc-1e41-4b1d-8050-bd70130ce2f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.673091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23d6fc-1e41-4b1d-8050-bd70130ce2f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:26.675194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23d6fc-1e41-4b1d-8050-bd70130ce2f4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-db23d6fc-1e41-4b1d-8050-bd70130ce2f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:26.685634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:26.686934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:26.687821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 436/877] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:26.688618 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23d6fc-1e41-4b1d-8050-bd70130ce2f4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:26.708928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:26.744603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f50f-a167-4ad3-b801-59069715c152 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:26.782682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b394a53-f38b-42a1-9950-265be9daa170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:26.783460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394a53-f38b-42a1-9950-265be9daa170 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.783838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394a53-f38b-42a1-9950-265be9daa170 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.784207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394a53-f38b-42a1-9950-265be9daa170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.785034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b394a53-f38b-42a1-9950-265be9daa170 None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=4c5af37aaa654585817e3aad0489d323) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:26.785441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b394a53-f38b-42a1-9950-265be9daa170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:26.786996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b394a53-f38b-42a1-9950-265be9daa170 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:26.792920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 442/878] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:26 2022] GET /identity/v3/role_assignments?user.id=4c5af37aaa654585817e3aad0489d323&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:26.793786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b394a53-f38b-42a1-9950-265be9daa170 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:26.810730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23d6fc-1e41-4b1d-8050-bd70130ce2f4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:26.850998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06155d2b-6ab1-4795-bc4b-4d2ed85ca49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:26.851903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06155d2b-6ab1-4795-bc4b-4d2ed85ca49e None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.852381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06155d2b-6ab1-4795-bc4b-4d2ed85ca49e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.852839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06155d2b-6ab1-4795-bc4b-4d2ed85ca49e None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.853788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06155d2b-6ab1-4795-bc4b-4d2ed85ca49e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:26.855848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06155d2b-6ab1-4795-bc4b-4d2ed85ca49e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:26.883796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 437/879] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:10:26 2022] POST /identity/v3/services => generated 269 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:26.930065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b394a53-f38b-42a1-9950-265be9daa170 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:26.933572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:26.979718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed2e2a-255d-4069-85bb-08699dd4544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:26.980812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed2e2a-255d-4069-85bb-08699dd4544e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:26.981089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed2e2a-255d-4069-85bb-08699dd4544e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:26.981363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed2e2a-255d-4069-85bb-08699dd4544e None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:26.982013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed2e2a-255d-4069-85bb-08699dd4544e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:26.982338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed2e2a-255d-4069-85bb-08699dd4544e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:26.983972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed2e2a-255d-4069-85bb-08699dd4544e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:26.989859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 443/880] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Sep 3 01:10:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:26.995729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06155d2b-6ab1-4795-bc4b-4d2ed85ca49e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:27.066993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba1dc-6893-495c-b8a5-3c31b6f972f9 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:27.067197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba1dc-6893-495c-b8a5-3c31b6f972f9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:27.067810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba1dc-6893-495c-b8a5-3c31b6f972f9 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:27.069070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 444/881] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:27.074632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c750948-b140-496e-b941-355af071a12e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:27.075191 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c750948-b140-496e-b941-355af071a12e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:27.075615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c750948-b140-496e-b941-355af071a12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:27.089854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:27.100835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-1c750948-b140-496e-b941-355af071a12e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:27.102050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1c750948-b140-496e-b941-355af071a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:27.122152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06155d2b-6ab1-4795-bc4b-4d2ed85ca49e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:27.157084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71048-5aa5-4b4b-831c-592a09dd897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:27.157802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71048-5aa5-4b4b-831c-592a09dd897f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:27.158146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71048-5aa5-4b4b-831c-592a09dd897f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:27.158505 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71048-5aa5-4b4b-831c-592a09dd897f None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:27.159200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71048-5aa5-4b4b-831c-592a09dd897f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:27.159599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71048-5aa5-4b4b-831c-592a09dd897f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:27.161021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71048-5aa5-4b4b-831c-592a09dd897f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:27.171355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 438/882] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Sep 3 01:10:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:27.215438 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 445/883] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:27.482972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71048-5aa5-4b4b-831c-592a09dd897f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:27.592404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71048-5aa5-4b4b-831c-592a09dd897f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:27.629027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bc449-00e0-4928-80ee-2c50c1970058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:27.630060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bc449-00e0-4928-80ee-2c50c1970058 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:27.630557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bc449-00e0-4928-80ee-2c50c1970058 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:27.631039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bc449-00e0-4928-80ee-2c50c1970058 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:27.631857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bc449-00e0-4928-80ee-2c50c1970058 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:27.633420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bc449-00e0-4928-80ee-2c50c1970058 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-114bc449-00e0-4928-80ee-2c50c1970058 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:27.642680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:27.643764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 01:10:27.644808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:27.647189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 439/884] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:10:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:27.658754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c750948-b140-496e-b941-355af071a12e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:27.737483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:27.752939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c750948-b140-496e-b941-355af071a12e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:27.794029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8b6f9-4467-4e78-a222-cbce937bb297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:27.794639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8b6f9-4467-4e78-a222-cbce937bb297 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:27.794914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8b6f9-4467-4e78-a222-cbce937bb297 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:27.795179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8b6f9-4467-4e78-a222-cbce937bb297 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:27.795837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8b6f9-4467-4e78-a222-cbce937bb297 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:27.796297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8b6f9-4467-4e78-a222-cbce937bb297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:27.797663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8b6f9-4467-4e78-a222-cbce937bb297 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:27.807048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 446/885] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:10:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:27.808430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bc449-00e0-4928-80ee-2c50c1970058 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:27.818545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:27.915160 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bc449-00e0-4928-80ee-2c50c1970058 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:27.950891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df37aca-7bf8-43f2-b600-2df6653991bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:27.952391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df37aca-7bf8-43f2-b600-2df6653991bf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:27.953061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df37aca-7bf8-43f2-b600-2df6653991bf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:27.953732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df37aca-7bf8-43f2-b600-2df6653991bf None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:27.955019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df37aca-7bf8-43f2-b600-2df6653991bf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:27.955634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df37aca-7bf8-43f2-b600-2df6653991bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:27.957124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df37aca-7bf8-43f2-b600-2df6653991bf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:27.962862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 440/886] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:10:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:27.968711 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8b6f9-4467-4e78-a222-cbce937bb297 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:28.070809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8b6f9-4467-4e78-a222-cbce937bb297 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:28.109352 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be4d5b-4436-49ef-91d2-8ed392d64bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:28.109965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be4d5b-4436-49ef-91d2-8ed392d64bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:28.110241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be4d5b-4436-49ef-91d2-8ed392d64bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:28.110511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be4d5b-4436-49ef-91d2-8ed392d64bb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:28.111278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be4d5b-4436-49ef-91d2-8ed392d64bb8 None admin] RBAC: Adding query filter params (interface=public, service_id=79337e86dc5940b7a9e1e95f2a8251b1, region_id=RegionOne) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:28.111595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be4d5b-4436-49ef-91d2-8ed392d64bb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:28.113015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be4d5b-4436-49ef-91d2-8ed392d64bb8 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:28.122816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 447/887] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Sep 3 01:10:27 2022] GET /identity/v3/endpoints?service_id=79337e86dc5940b7a9e1e95f2a8251b1&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:28.124294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df37aca-7bf8-43f2-b600-2df6653991bf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:28.209451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:28.241116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df37aca-7bf8-43f2-b600-2df6653991bf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:28.277727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d4098-e7d6-4e12-b7aa-64b1637507ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:28.278399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d4098-e7d6-4e12-b7aa-64b1637507ab None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:28.278681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d4098-e7d6-4e12-b7aa-64b1637507ab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:28.278955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d4098-e7d6-4e12-b7aa-64b1637507ab None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:28.279590 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d4098-e7d6-4e12-b7aa-64b1637507ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:28.281222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d4098-e7d6-4e12-b7aa-64b1637507ab None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:28.287371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 441/888] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Sep 3 01:10:28 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:10:28.958438 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fa31-b945-4abf-bdf6-8a87d1e0672f None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:28.959004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da2b76-9810-4ef1-b7fd-03c007412952 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:28.959004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da2b76-9810-4ef1-b7fd-03c007412952 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:28.959004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da2b76-9810-4ef1-b7fd-03c007412952 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:28.960241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fa31-b945-4abf-bdf6-8a87d1e0672f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:28.960720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 442/889] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:28.961309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fa31-b945-4abf-bdf6-8a87d1e0672f None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:28.964258 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 448/890] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:28.969730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3457a9-6bfa-4a32-81ce-fa5193e61d72 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:28.970011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3457a9-6bfa-4a32-81ce-fa5193e61d72 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:28.970289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3457a9-6bfa-4a32-81ce-fa5193e61d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:28.972160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281dead-f907-46a7-91ab-60925bcf2a34 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:28.972415 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281dead-f907-46a7-91ab-60925bcf2a34 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:28.972714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281dead-f907-46a7-91ab-60925bcf2a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:28.993752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a281dead-f907-46a7-91ab-60925bcf2a34 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:28.994944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a281dead-f907-46a7-91ab-60925bcf2a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:28.996269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ae3457a9-6bfa-4a32-81ce-fa5193e61d72 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:28.997672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ae3457a9-6bfa-4a32-81ce-fa5193e61d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:29.002886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:29.071291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 449/891] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:10:29.073756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 443/892] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:29.082843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aea4b-683e-438a-ba84-51a54e8dacf7 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:29.083201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aea4b-683e-438a-ba84-51a54e8dacf7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:29.083513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aea4b-683e-438a-ba84-51a54e8dacf7 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:29.085112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 450/893] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:29.090449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165be8-2c48-45b3-8a26-b57c7a416418 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:29.090734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165be8-2c48-45b3-8a26-b57c7a416418 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:29.091006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165be8-2c48-45b3-8a26-b57c7a416418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:29.109663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-09165be8-2c48-45b3-8a26-b57c7a416418 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:29.110857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-09165be8-2c48-45b3-8a26-b57c7a416418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:29.169931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:29.189163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 444/894] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:29.341612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aea4b-683e-438a-ba84-51a54e8dacf7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:29.355763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09165be8-2c48-45b3-8a26-b57c7a416418 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:29.467971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aea4b-683e-438a-ba84-51a54e8dacf7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:29.473085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09165be8-2c48-45b3-8a26-b57c7a416418 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:29.505124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79409b2d-1c2d-495b-87b6-29ddb4e52d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:29.505727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79409b2d-1c2d-495b-87b6-29ddb4e52d76 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:29.506041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79409b2d-1c2d-495b-87b6-29ddb4e52d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:29.506304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79409b2d-1c2d-495b-87b6-29ddb4e52d76 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:29.506932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79409b2d-1c2d-495b-87b6-29ddb4e52d76 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:29.508294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79409b2d-1c2d-495b-87b6-29ddb4e52d76 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:29.510084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3add2-2567-4534-8c8e-98dc15e13da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:29.510706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3add2-2567-4534-8c8e-98dc15e13da4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:29.510987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3add2-2567-4534-8c8e-98dc15e13da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:29.511279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3add2-2567-4534-8c8e-98dc15e13da4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-79409b2d-1c2d-495b-87b6-29ddb4e52d76 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:29.517557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:29.518472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:29.519553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 451/895] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Sep 3 01:10:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:29.520927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79409b2d-1c2d-495b-87b6-29ddb4e52d76 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:29.527889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3add2-2567-4534-8c8e-98dc15e13da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-19c3add2-2567-4534-8c8e-98dc15e13da4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:29.532846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:29.533846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 445/896] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Sep 3 01:10:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:29.534680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3add2-2567-4534-8c8e-98dc15e13da4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:29.546868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:29.594533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:29.645780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3add2-2567-4534-8c8e-98dc15e13da4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:29.651750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79409b2d-1c2d-495b-87b6-29ddb4e52d76 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:29.680852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25378e-7136-464c-8f7f-f4647c79e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:29.681464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25378e-7136-464c-8f7f-f4647c79e26e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:29.681738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25378e-7136-464c-8f7f-f4647c79e26e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:29.682009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25378e-7136-464c-8f7f-f4647c79e26e None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:29.682639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25378e-7136-464c-8f7f-f4647c79e26e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:29.683005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25378e-7136-464c-8f7f-f4647c79e26e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:29.684339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25378e-7136-464c-8f7f-f4647c79e26e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:29.686281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830e729-165f-492f-8638-d5c68aa9fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:29.686927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e729-165f-492f-8638-d5c68aa9fbd7 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:29.687210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e729-165f-492f-8638-d5c68aa9fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:29.687512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e729-165f-492f-8638-d5c68aa9fbd7 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:29.688160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830e729-165f-492f-8638-d5c68aa9fbd7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:29.689486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 446/897] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:29.689587 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830e729-165f-492f-8638-d5c68aa9fbd7 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:29.690274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25378e-7136-464c-8f7f-f4647c79e26e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:29.711397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 452/898] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:10:29 2022] POST /identity/v3/services => generated 241 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:29.711397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830e729-165f-492f-8638-d5c68aa9fbd7 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:29.803889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:29.822957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25378e-7136-464c-8f7f-f4647c79e26e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:29.852608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:29.863701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830e729-165f-492f-8638-d5c68aa9fbd7 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:29.880471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363f9c8-0ca4-409e-94d3-6b3cd8a8619a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:29.881103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363f9c8-0ca4-409e-94d3-6b3cd8a8619a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:29.881389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363f9c8-0ca4-409e-94d3-6b3cd8a8619a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:29.881659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363f9c8-0ca4-409e-94d3-6b3cd8a8619a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:29.882341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363f9c8-0ca4-409e-94d3-6b3cd8a8619a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:29.882642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363f9c8-0ca4-409e-94d3-6b3cd8a8619a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:29.884252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363f9c8-0ca4-409e-94d3-6b3cd8a8619a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:29.903428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 447/899] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Sep 3 01:10:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:29.903428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363f9c8-0ca4-409e-94d3-6b3cd8a8619a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:29.917101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6ba83-c5d1-4808-b1dc-ad65d3076594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:29.917782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ba83-c5d1-4808-b1dc-ad65d3076594 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:29.918068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ba83-c5d1-4808-b1dc-ad65d3076594 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:29.918343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ba83-c5d1-4808-b1dc-ad65d3076594 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:29.918986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6ba83-c5d1-4808-b1dc-ad65d3076594 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:29.919342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6ba83-c5d1-4808-b1dc-ad65d3076594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:29.921383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6ba83-c5d1-4808-b1dc-ad65d3076594 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:29.927552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 453/900] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:29.933254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6ba83-c5d1-4808-b1dc-ad65d3076594 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:30.021578 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363f9c8-0ca4-409e-94d3-6b3cd8a8619a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:30.057409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca0928-9b20-497e-97c9-2a1b40586df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:30.058045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0928-9b20-497e-97c9-2a1b40586df9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:30.058415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0928-9b20-497e-97c9-2a1b40586df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:30.058641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0928-9b20-497e-97c9-2a1b40586df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:30.070376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca0928-9b20-497e-97c9-2a1b40586df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:30.071861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca0928-9b20-497e-97c9-2a1b40586df9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:30.072343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6ba83-c5d1-4808-b1dc-ad65d3076594 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c9ca0928-9b20-497e-97c9-2a1b40586df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:30.088021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:30.089126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:30.090085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:30.090085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:30.090085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:30.092315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 448/901] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:30.098334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca0928-9b20-497e-97c9-2a1b40586df9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:30.108217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:30.123117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84485d5-f855-4e92-b3f7-f044d41fc998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:30.123774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84485d5-f855-4e92-b3f7-f044d41fc998 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:30.124051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84485d5-f855-4e92-b3f7-f044d41fc998 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:30.124373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84485d5-f855-4e92-b3f7-f044d41fc998 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:30.125085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84485d5-f855-4e92-b3f7-f044d41fc998 None admin] RBAC: Adding query filter params (interface=public, service_id=ab254a38d9364871ac87bcdf941f4a83, region_id=RegionOne) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:30.125524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84485d5-f855-4e92-b3f7-f044d41fc998 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:30.126978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84485d5-f855-4e92-b3f7-f044d41fc998 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:30.139195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 454/902] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Sep 3 01:10:29 2022] GET /identity/v3/endpoints?service_id=ab254a38d9364871ac87bcdf941f4a83&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:30.141115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84485d5-f855-4e92-b3f7-f044d41fc998 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:30.142322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:30.234461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca0928-9b20-497e-97c9-2a1b40586df9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:30.257349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84485d5-f855-4e92-b3f7-f044d41fc998 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:30.272552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217408-3e63-488d-89d9-54f48d17598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:30.273169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217408-3e63-488d-89d9-54f48d17598c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:30.273452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217408-3e63-488d-89d9-54f48d17598c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:30.273722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217408-3e63-488d-89d9-54f48d17598c None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:30.274369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217408-3e63-488d-89d9-54f48d17598c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:30.274669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217408-3e63-488d-89d9-54f48d17598c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:30.276056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217408-3e63-488d-89d9-54f48d17598c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:30.288328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 449/903] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:30.289569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9689e9-6db1-4d0e-8546-9e6ae3c85e1e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:30.289854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9689e9-6db1-4d0e-8546-9e6ae3c85e1e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:30.290128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9689e9-6db1-4d0e-8546-9e6ae3c85e1e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:30.295295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 450/904] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:30.295295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9689e9-6db1-4d0e-8546-9e6ae3c85e1e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:30.299939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a87b4-60b5-46d3-91a0-2afa6da22fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:30.300557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a87b4-60b5-46d3-91a0-2afa6da22fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:30.300833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a87b4-60b5-46d3-91a0-2afa6da22fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:30.301100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a87b4-60b5-46d3-91a0-2afa6da22fc1 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:30.301699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a87b4-60b5-46d3-91a0-2afa6da22fc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:30.303070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a87b4-60b5-46d3-91a0-2afa6da22fc1 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:30.309865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 455/905] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Sep 3 01:10:30 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:10:30.310875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72486d3-e229-440a-ab4d-2b5279e3f756 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:30.311154 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72486d3-e229-440a-ab4d-2b5279e3f756 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:30.311450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72486d3-e229-440a-ab4d-2b5279e3f756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:30.331426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e72486d3-e229-440a-ab4d-2b5279e3f756 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:30.332709 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e72486d3-e229-440a-ab4d-2b5279e3f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:30.389984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:30.419836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 456/906] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:30.427448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:30.438845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9689e9-6db1-4d0e-8546-9e6ae3c85e1e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:30.475769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65070567-bfa3-4849-8734-8a8befea9556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:30.476796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65070567-bfa3-4849-8734-8a8befea9556 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:30.477279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65070567-bfa3-4849-8734-8a8befea9556 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:30.477744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65070567-bfa3-4849-8734-8a8befea9556 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:30.485540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65070567-bfa3-4849-8734-8a8befea9556 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:30.487193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65070567-bfa3-4849-8734-8a8befea9556 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-65070567-bfa3-4849-8734-8a8befea9556 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:30.499334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:30.500481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:30.501423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:30.501423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:30.501423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:30.501423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:30.501423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:30.501423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:30.501423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:30.501423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:30.501423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:30.501423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:30.502144 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 451/907] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Sep 3 01:10:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:30.508494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72486d3-e229-440a-ab4d-2b5279e3f756 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:30.612411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72486d3-e229-440a-ab4d-2b5279e3f756 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:30.647522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457470d-a214-4766-a922-12becd5bf4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:30.648460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457470d-a214-4766-a922-12becd5bf4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:30.648933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457470d-a214-4766-a922-12becd5bf4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:30.649399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457470d-a214-4766-a922-12becd5bf4e9 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:30.650340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457470d-a214-4766-a922-12becd5bf4e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:30.650837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457470d-a214-4766-a922-12becd5bf4e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:30.652508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457470d-a214-4766-a922-12becd5bf4e9 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:30.675450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 457/908] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Sep 3 01:10:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:30.677548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65070567-bfa3-4849-8734-8a8befea9556 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:30.680365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457470d-a214-4766-a922-12becd5bf4e9 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:30.738779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:30.791368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65070567-bfa3-4849-8734-8a8befea9556 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:30.805187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457470d-a214-4766-a922-12becd5bf4e9 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:30.825710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25294c4f-7334-4a6c-b272-808e5e1acb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:30.826333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25294c4f-7334-4a6c-b272-808e5e1acb47 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:30.826607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25294c4f-7334-4a6c-b272-808e5e1acb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:30.826874 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25294c4f-7334-4a6c-b272-808e5e1acb47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:30.848748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe982c-8399-4521-9c8d-f1e5fb323e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:30.849710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:30.850954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe982c-8399-4521-9c8d-f1e5fb323e12 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:30.851453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe982c-8399-4521-9c8d-f1e5fb323e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:30.852043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe982c-8399-4521-9c8d-f1e5fb323e12 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:30.852962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe982c-8399-4521-9c8d-f1e5fb323e12 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:30.856182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe982c-8399-4521-9c8d-f1e5fb323e12 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-1fbe982c-8399-4521-9c8d-f1e5fb323e12 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:30.869196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:30.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 01:10:30.871101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:30.875595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 458/909] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:10:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:30.878416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe982c-8399-4521-9c8d-f1e5fb323e12 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:30.914940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25294c4f-7334-4a6c-b272-808e5e1acb47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:30.916413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25294c4f-7334-4a6c-b272-808e5e1acb47 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:31.018069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe982c-8399-4521-9c8d-f1e5fb323e12 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:31.027452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:31.055283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 452/910] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:30 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:10:31.058522 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25294c4f-7334-4a6c-b272-808e5e1acb47 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:31.066075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe958547-e4e5-4fed-81c8-5c38013d67f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:31.066783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958547-e4e5-4fed-81c8-5c38013d67f0 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:31.067131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958547-e4e5-4fed-81c8-5c38013d67f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:31.067497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958547-e4e5-4fed-81c8-5c38013d67f0 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:31.068640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe958547-e4e5-4fed-81c8-5c38013d67f0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:31.069014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe958547-e4e5-4fed-81c8-5c38013d67f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:31.070470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe958547-e4e5-4fed-81c8-5c38013d67f0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:31.077397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 459/911] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:10:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:31.082480 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe958547-e4e5-4fed-81c8-5c38013d67f0 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:31.122683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:31.186486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25294c4f-7334-4a6c-b272-808e5e1acb47 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:31.218378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe958547-e4e5-4fed-81c8-5c38013d67f0 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:31.224751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf7eac-d7b7-4c7a-8f89-6b93a7c20927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:31.225395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7eac-d7b7-4c7a-8f89-6b93a7c20927 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:31.225669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7eac-d7b7-4c7a-8f89-6b93a7c20927 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:31.225938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7eac-d7b7-4c7a-8f89-6b93a7c20927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:31.236871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf7eac-d7b7-4c7a-8f89-6b93a7c20927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:31.238314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf7eac-d7b7-4c7a-8f89-6b93a7c20927 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-eebf7eac-d7b7-4c7a-8f89-6b93a7c20927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:31.253389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:31.254360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:31.255239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:31.255239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:31.255239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:31.259523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 453/912] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:31.260510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf7eac-d7b7-4c7a-8f89-6b93a7c20927 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:31.263291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79c6f7-8ede-4835-b614-f9b3754bd017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:31.264410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79c6f7-8ede-4835-b614-f9b3754bd017 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:31.265829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79c6f7-8ede-4835-b614-f9b3754bd017 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:31.266318 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79c6f7-8ede-4835-b614-f9b3754bd017 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:31.267203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79c6f7-8ede-4835-b614-f9b3754bd017 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:31.267867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79c6f7-8ede-4835-b614-f9b3754bd017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:31.269423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79c6f7-8ede-4835-b614-f9b3754bd017 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:31.276846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 460/913] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Sep 3 01:10:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:31.283295 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79c6f7-8ede-4835-b614-f9b3754bd017 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:31.320312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:31.373235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf7eac-d7b7-4c7a-8f89-6b93a7c20927 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:31.375898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:31.403832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79c6f7-8ede-4835-b614-f9b3754bd017 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:31.408579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72d12c-9a8c-441c-9022-74baa326b1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:31.409298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d12c-9a8c-441c-9022-74baa326b1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:31.409667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d12c-9a8c-441c-9022-74baa326b1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:31.410024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d12c-9a8c-441c-9022-74baa326b1c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:31.410753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72d12c-9a8c-441c-9022-74baa326b1c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:31.411179 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72d12c-9a8c-441c-9022-74baa326b1c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:31.412690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72d12c-9a8c-441c-9022-74baa326b1c6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:31.429704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 454/914] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:31.430967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72d12c-9a8c-441c-9022-74baa326b1c6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:31.461559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cffa2-2ab3-4eeb-a974-bf83cd46836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:31.462090 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cffa2-2ab3-4eeb-a974-bf83cd46836c None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:31.462364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cffa2-2ab3-4eeb-a974-bf83cd46836c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:31.462632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cffa2-2ab3-4eeb-a974-bf83cd46836c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:31.463319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cffa2-2ab3-4eeb-a974-bf83cd46836c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:31.464757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cffa2-2ab3-4eeb-a974-bf83cd46836c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:31.495479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 461/915] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:10:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:10:31.563151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72d12c-9a8c-441c-9022-74baa326b1c6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:31.610891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a7e1b-1f3e-4f59-b7ac-a0ae3f95dbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:31.611961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a7e1b-1f3e-4f59-b7ac-a0ae3f95dbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:31.612466 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a7e1b-1f3e-4f59-b7ac-a0ae3f95dbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:31.612936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a7e1b-1f3e-4f59-b7ac-a0ae3f95dbc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:31.621258 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a7e1b-1f3e-4f59-b7ac-a0ae3f95dbc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:31.623152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a7e1b-1f3e-4f59-b7ac-a0ae3f95dbc0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d29a7e1b-1f3e-4f59-b7ac-a0ae3f95dbc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:31.636604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:31.637626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:31.638517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:31.638517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:31.638517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:31.638517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:31.638517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:31.638517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:31.638517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:31.638517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:31.641553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 455/916] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:31.647638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cffa2-2ab3-4eeb-a974-bf83cd46836c None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:31.744759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:31.756280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cffa2-2ab3-4eeb-a974-bf83cd46836c None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:31.766129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2ba9d-6143-4504-81d3-2a497e582332 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:31.766434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2ba9d-6143-4504-81d3-2a497e582332 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:31.766680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2ba9d-6143-4504-81d3-2a497e582332 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:31.769301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 456/917] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:31.773358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755c5f9-6fdf-4ef8-9aa7-1aa5e3166b2a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:31.773641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755c5f9-6fdf-4ef8-9aa7-1aa5e3166b2a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:31.773921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755c5f9-6fdf-4ef8-9aa7-1aa5e3166b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:31.792777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7755c5f9-6fdf-4ef8-9aa7-1aa5e3166b2a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:31.793961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7755c5f9-6fdf-4ef8-9aa7-1aa5e3166b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:31.798432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4fe78-977c-43ce-8b1e-bdda3b7e2d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:31.799263 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4fe78-977c-43ce-8b1e-bdda3b7e2d68 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:31.799704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4fe78-977c-43ce-8b1e-bdda3b7e2d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:31.800177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4fe78-977c-43ce-8b1e-bdda3b7e2d68 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:31.801131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4fe78-977c-43ce-8b1e-bdda3b7e2d68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:31.801574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4fe78-977c-43ce-8b1e-bdda3b7e2d68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:31.803653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4fe78-977c-43ce-8b1e-bdda3b7e2d68 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:31.809657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:31.824471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 462/918] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:31.830998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4fe78-977c-43ce-8b1e-bdda3b7e2d68 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:31.875435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 457/919] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:31.938184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4fe78-977c-43ce-8b1e-bdda3b7e2d68 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:31.972443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2e772-8a6e-4541-a771-c4589a03c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:31.973132 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2e772-8a6e-4541-a771-c4589a03c862 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:31.973409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2e772-8a6e-4541-a771-c4589a03c862 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:31.973674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2e772-8a6e-4541-a771-c4589a03c862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:31.974390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2e772-8a6e-4541-a771-c4589a03c862 None admin] RBAC: Adding query filter params (role.id=719d26d82310436eb8ca76e8097c43ec, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=4c5af37aaa654585817e3aad0489d323) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:31.974690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2e772-8a6e-4541-a771-c4589a03c862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:31.976165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2e772-8a6e-4541-a771-c4589a03c862 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:31.982321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 463/920] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:31 2022] GET /identity/v3/role_assignments?user.id=4c5af37aaa654585817e3aad0489d323&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=719d26d82310436eb8ca76e8097c43ec => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:32.133608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755c5f9-6fdf-4ef8-9aa7-1aa5e3166b2a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:32.234341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755c5f9-6fdf-4ef8-9aa7-1aa5e3166b2a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:32.268966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f6f4a-3fe9-4b52-9066-40a172549303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:32.269607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f6f4a-3fe9-4b52-9066-40a172549303 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:32.269881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f6f4a-3fe9-4b52-9066-40a172549303 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:32.270149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f6f4a-3fe9-4b52-9066-40a172549303 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:32.270734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f6f4a-3fe9-4b52-9066-40a172549303 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:32.272115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f6f4a-3fe9-4b52-9066-40a172549303 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b79f6f4a-3fe9-4b52-9066-40a172549303 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:32.281071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:32.282047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:32.282879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:32.286229 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbc831-3631-4e19-9d34-ebd075d29571 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:32.286692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbc831-3631-4e19-9d34-ebd075d29571 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:32.286853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbc831-3631-4e19-9d34-ebd075d29571 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:32.287174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 458/921] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:32.288381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 464/922] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:32.288553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f6f4a-3fe9-4b52-9066-40a172549303 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:32.293545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1a53-0ccf-46aa-9064-38cf33c75237 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:32.293827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1a53-0ccf-46aa-9064-38cf33c75237 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:32.294106 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1a53-0ccf-46aa-9064-38cf33c75237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:32.307612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:32.315682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-db3f1a53-0ccf-46aa-9064-38cf33c75237 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:32.317172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-db3f1a53-0ccf-46aa-9064-38cf33c75237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:32.339596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:32.398390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f6f4a-3fe9-4b52-9066-40a172549303 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:32.401498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 465/923] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:10:32.433840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696c0a8-a485-4ee7-9104-990f6cb4d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:32.434448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696c0a8-a485-4ee7-9104-990f6cb4d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:32.434720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696c0a8-a485-4ee7-9104-990f6cb4d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:32.434989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696c0a8-a485-4ee7-9104-990f6cb4d8b9 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:32.435642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696c0a8-a485-4ee7-9104-990f6cb4d8b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:32.435937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696c0a8-a485-4ee7-9104-990f6cb4d8b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:32.437324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696c0a8-a485-4ee7-9104-990f6cb4d8b9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:32.446330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 459/924] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Sep 3 01:10:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:32.448390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1a53-0ccf-46aa-9064-38cf33c75237 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:32.547337 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1a53-0ccf-46aa-9064-38cf33c75237 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:32.581724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d456ec7-e736-4f75-b7bf-ff093781bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:32.582342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d456ec7-e736-4f75-b7bf-ff093781bfdd None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:32.582620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d456ec7-e736-4f75-b7bf-ff093781bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:32.582891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d456ec7-e736-4f75-b7bf-ff093781bfdd None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:32.583552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d456ec7-e736-4f75-b7bf-ff093781bfdd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:32.583860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d456ec7-e736-4f75-b7bf-ff093781bfdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:32.585239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d456ec7-e736-4f75-b7bf-ff093781bfdd None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:32.590787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 466/925] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Sep 3 01:10:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:32.597456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696c0a8-a485-4ee7-9104-990f6cb4d8b9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:32.683576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:32.701526 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d456ec7-e736-4f75-b7bf-ff093781bfdd None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:32.709088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696c0a8-a485-4ee7-9104-990f6cb4d8b9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:32.750022 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:32.751407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad100f4a-4ec3-479b-bb6d-2267458ec847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:32.752024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad100f4a-4ec3-479b-bb6d-2267458ec847 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:32.752300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad100f4a-4ec3-479b-bb6d-2267458ec847 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:32.752569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad100f4a-4ec3-479b-bb6d-2267458ec847 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:32.753269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad100f4a-4ec3-479b-bb6d-2267458ec847 None admin] RBAC: Adding query filter params (interface=public, service_id=c02e374176f54be4a3ac16920be7c53d, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:32.753970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad100f4a-4ec3-479b-bb6d-2267458ec847 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:32.755664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad100f4a-4ec3-479b-bb6d-2267458ec847 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:32.762525 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 460/926] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Sep 3 01:10:32 2022] GET /identity/v3/endpoints?service_id=c02e374176f54be4a3ac16920be7c53d&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:32.768866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad100f4a-4ec3-479b-bb6d-2267458ec847 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:32.804931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d456ec7-e736-4f75-b7bf-ff093781bfdd None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:32.838399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f3af5-6c35-4c01-aefc-16d7ce79bf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:32.839030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f3af5-6c35-4c01-aefc-16d7ce79bf17 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:32.839334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f3af5-6c35-4c01-aefc-16d7ce79bf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:32.839611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f3af5-6c35-4c01-aefc-16d7ce79bf17 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:32.840191 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f3af5-6c35-4c01-aefc-16d7ce79bf17 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:32.841567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f3af5-6c35-4c01-aefc-16d7ce79bf17 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-4d5f3af5-6c35-4c01-aefc-16d7ce79bf17 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:32.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:32.851061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 01:10:32.851985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:32.856677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 467/927] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Sep 3 01:10:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:32.857946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f3af5-6c35-4c01-aefc-16d7ce79bf17 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:32.881571 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad100f4a-4ec3-479b-bb6d-2267458ec847 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:32.915752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7726908-3548-4e6b-a3a3-ade8035c2fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:32.916514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7726908-3548-4e6b-a3a3-ade8035c2fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:32.916935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7726908-3548-4e6b-a3a3-ade8035c2fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:32.917302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7726908-3548-4e6b-a3a3-ade8035c2fe1 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:32.918002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7726908-3548-4e6b-a3a3-ade8035c2fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:32.919480 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7726908-3548-4e6b-a3a3-ade8035c2fe1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:32.926135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 461/928] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Sep 3 01:10:32 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:10:32.939787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:32.967494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f3af5-6c35-4c01-aefc-16d7ce79bf17 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:33.007039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19b156-7b3a-42b4-aa0e-9d5bb4fd149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:33.008074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19b156-7b3a-42b4-aa0e-9d5bb4fd149d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:33.008529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19b156-7b3a-42b4-aa0e-9d5bb4fd149d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:33.008975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19b156-7b3a-42b4-aa0e-9d5bb4fd149d None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:33.009797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19b156-7b3a-42b4-aa0e-9d5bb4fd149d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:33.010274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19b156-7b3a-42b4-aa0e-9d5bb4fd149d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:33.011906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19b156-7b3a-42b4-aa0e-9d5bb4fd149d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:33.018561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 468/929] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:33.024456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7726908-3548-4e6b-a3a3-ade8035c2fe1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:33.035623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:33.138479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7726908-3548-4e6b-a3a3-ade8035c2fe1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:33.174237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad6fd6-24fe-44a6-aefb-266fff992f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:33.174894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6fd6-24fe-44a6-aefb-266fff992f47 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:33.175179 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6fd6-24fe-44a6-aefb-266fff992f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:33.175477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6fd6-24fe-44a6-aefb-266fff992f47 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:33.178821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad6fd6-24fe-44a6-aefb-266fff992f47 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:33.178821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad6fd6-24fe-44a6-aefb-266fff992f47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:33.178821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad6fd6-24fe-44a6-aefb-266fff992f47 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:33.187418 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 462/930] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:33.189155 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19b156-7b3a-42b4-aa0e-9d5bb4fd149d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:33.299069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19b156-7b3a-42b4-aa0e-9d5bb4fd149d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:33.334704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3635c98-d3d4-4826-83dd-61df32902bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:33.339967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3635c98-d3d4-4826-83dd-61df32902bc6 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:33.339967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3635c98-d3d4-4826-83dd-61df32902bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:33.339967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3635c98-d3d4-4826-83dd-61df32902bc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:33.339967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3635c98-d3d4-4826-83dd-61df32902bc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:33.339967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3635c98-d3d4-4826-83dd-61df32902bc6 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:33.343639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:33.362167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 469/931] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:10:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:33.545810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473755ba-ecd8-4c9e-9297-549e83c65e08 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:33.546467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473755ba-ecd8-4c9e-9297-549e83c65e08 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:33.546845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473755ba-ecd8-4c9e-9297-549e83c65e08 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:33.548564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 463/932] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:33.554114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdad9de-1e6c-4e20-84a9-37194da4ec12 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:33.554631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdad9de-1e6c-4e20-84a9-37194da4ec12 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:33.555003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdad9de-1e6c-4e20-84a9-37194da4ec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:33.575349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0fdad9de-1e6c-4e20-84a9-37194da4ec12 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:33.576481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0fdad9de-1e6c-4e20-84a9-37194da4ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:33.655563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 470/933] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:33.929960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473755ba-ecd8-4c9e-9297-549e83c65e08 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:34.000801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:34.035824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473755ba-ecd8-4c9e-9297-549e83c65e08 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:34.041702 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de7d4f-2bd6-4788-84c8-67bbc05f7886 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:34.041984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de7d4f-2bd6-4788-84c8-67bbc05f7886 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:34.042253 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de7d4f-2bd6-4788-84c8-67bbc05f7886 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:34.043885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 471/934] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:34.051962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864c014-0bec-46a2-b5b3-ac238f73ced9 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:34.052344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864c014-0bec-46a2-b5b3-ac238f73ced9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:34.053085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864c014-0bec-46a2-b5b3-ac238f73ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:34.072722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:34.073349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:34.073625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:34.073898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:34.074570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:34.076064 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:34.076809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7864c014-0bec-46a2-b5b3-ac238f73ced9 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:34.078343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7864c014-0bec-46a2-b5b3-ac238f73ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:34.079034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WARNING keystone.server.flask.common [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 03 01:10:34.101272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.sql.core [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 01:10:34.101272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 03 01:10:34.101272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [parameters: {'id': 'e6fce1c3999740b7877831f2bfbd2c33', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 03 01:10:34.101272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e6fce1c3999740b7877831f2bfbd2c33.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e6fce1c3999740b7877831f2bfbd2c33. Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 01:10:34.123503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 03 01:10:34.124612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application yield resource Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.rollback() Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.force_reraise() Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise self.value Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application session.commit() Sep 03 01:10:34.125890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._prepare_impl() Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.flush() Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._flush(objects) Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application compat.raise_( Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application flush_context.execute() Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 01:10:34.126770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rec.execute(self) Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 03 01:10:34.127711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 01:10:34.128758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [parameters: {'id': 'e6fce1c3999740b7877831f2bfbd2c33', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:34.130000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:34.131624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e6fce1c3999740b7877831f2bfbd2c33. Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 464/935] 10.222.0.39 () {60 vars in 1140 bytes} [Sat Sep 3 01:10:33 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:34.141019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:34.160826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 472/936] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:34.249506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c90050-7d5b-4090-96fe-b74cc97616b0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:34.276896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:34.286764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584c58-92e7-478d-aedf-47f8307e72cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:34.287450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584c58-92e7-478d-aedf-47f8307e72cd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:34.287732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584c58-92e7-478d-aedf-47f8307e72cd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:34.288085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584c58-92e7-478d-aedf-47f8307e72cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:34.294907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29584c58-92e7-478d-aedf-47f8307e72cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:34.296733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29584c58-92e7-478d-aedf-47f8307e72cd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-29584c58-92e7-478d-aedf-47f8307e72cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:34.308043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:34.310024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:34.312549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:34.312549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:34.312549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:34.312549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:34.312549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:34.312549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:34.312549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:34.312549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:34.312549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 465/937] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:34.316562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864c014-0bec-46a2-b5b3-ac238f73ced9 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:34.368992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:34.425474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864c014-0bec-46a2-b5b3-ac238f73ced9 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:34.460923 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641efd93-9085-4067-991b-4242e4b10113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:34.461532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641efd93-9085-4067-991b-4242e4b10113 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:34.461815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641efd93-9085-4067-991b-4242e4b10113 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:34.462090 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641efd93-9085-4067-991b-4242e4b10113 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:34.462784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641efd93-9085-4067-991b-4242e4b10113 None admin] RBAC: Adding query filter params (name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:34.463077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641efd93-9085-4067-991b-4242e4b10113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:34.464605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641efd93-9085-4067-991b-4242e4b10113 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:34.481197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584c58-92e7-478d-aedf-47f8307e72cd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:34.486832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 473/938] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:34 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:34.596831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584c58-92e7-478d-aedf-47f8307e72cd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:34.634637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62890b-5ff2-4c70-ae2c-de60c845298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:34.635718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62890b-5ff2-4c70-ae2c-de60c845298c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:34.636210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62890b-5ff2-4c70-ae2c-de60c845298c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:34.636674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62890b-5ff2-4c70-ae2c-de60c845298c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:34.647857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62890b-5ff2-4c70-ae2c-de60c845298c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ba62890b-5ff2-4c70-ae2c-de60c845298c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:34.653560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:34.654494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:34.655443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:34.656898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 466/939] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Sep 3 01:10:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:34.663007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641efd93-9085-4067-991b-4242e4b10113 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:34.773328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641efd93-9085-4067-991b-4242e4b10113 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:34.782993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:34.809940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf2604-d5f1-4779-af88-cf63b941e6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:34.810904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2604-d5f1-4779-af88-cf63b941e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:34.811436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2604-d5f1-4779-af88-cf63b941e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:34.811926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2604-d5f1-4779-af88-cf63b941e6e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:34.812847 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf2604-d5f1-4779-af88-cf63b941e6e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:34.813357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf2604-d5f1-4779-af88-cf63b941e6e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:34.815017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf2604-d5f1-4779-af88-cf63b941e6e9 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:34.824031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 474/940] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Sep 3 01:10:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:34.829724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62890b-5ff2-4c70-ae2c-de60c845298c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:34.878907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:34.933107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62890b-5ff2-4c70-ae2c-de60c845298c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:34.968763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38503b-931a-4fce-9adc-c380584b9c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:34.969775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38503b-931a-4fce-9adc-c380584b9c6c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:34.970243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38503b-931a-4fce-9adc-c380584b9c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:34.970706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38503b-931a-4fce-9adc-c380584b9c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:34.982245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38503b-931a-4fce-9adc-c380584b9c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:34.984058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38503b-931a-4fce-9adc-c380584b9c6c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:34.988925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a772e-f862-4552-9d1b-182c02a0ec3c None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:34.989209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a772e-f862-4552-9d1b-182c02a0ec3c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:34.989479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a772e-f862-4552-9d1b-182c02a0ec3c None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:34.990823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 475/941] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:34.996388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86882852-7932-41b2-b6c0-7e0d8766962c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:34.996895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86882852-7932-41b2-b6c0-7e0d8766962c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:34.997365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86882852-7932-41b2-b6c0-7e0d8766962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ec38503b-931a-4fce-9adc-c380584b9c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:35.003377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:35.004320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:35.005214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:35.005214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:35.005214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:35.005214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 467/942] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:35.011440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38503b-931a-4fce-9adc-c380584b9c6c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:35.020149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-86882852-7932-41b2-b6c0-7e0d8766962c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:35.021745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-86882852-7932-41b2-b6c0-7e0d8766962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:35.106910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 476/943] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:35.136033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38503b-931a-4fce-9adc-c380584b9c6c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:35.139692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:35.181811 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f767516-430c-44f1-b81a-6da98803feae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:35.182608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f767516-430c-44f1-b81a-6da98803feae None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:35.183057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f767516-430c-44f1-b81a-6da98803feae None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:35.183506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f767516-430c-44f1-b81a-6da98803feae None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.184318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f767516-430c-44f1-b81a-6da98803feae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:35.184760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f767516-430c-44f1-b81a-6da98803feae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:35.186260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f767516-430c-44f1-b81a-6da98803feae None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:35.208264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 468/944] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:35.214016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86882852-7932-41b2-b6c0-7e0d8766962c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:35.285288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80ddf1-0803-448a-b921-6b69d65a5cb5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:35.285624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80ddf1-0803-448a-b921-6b69d65a5cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:35.285835 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80ddf1-0803-448a-b921-6b69d65a5cb5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.288407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 469/945] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:35.292329 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e972-ad6e-41d3-8678-88d8bf776cf0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:35.292606 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e972-ad6e-41d3-8678-88d8bf776cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:35.292879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e972-ad6e-41d3-8678-88d8bf776cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.313023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7da5e972-ad6e-41d3-8678-88d8bf776cf0 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:35.314538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7da5e972-ad6e-41d3-8678-88d8bf776cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:35.319825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86882852-7932-41b2-b6c0-7e0d8766962c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:35.331626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:35.364710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d95668-b060-4fbe-a02f-74b6d81a564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:35.365380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d95668-b060-4fbe-a02f-74b6d81a564d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:35.365727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d95668-b060-4fbe-a02f-74b6d81a564d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:35.366357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d95668-b060-4fbe-a02f-74b6d81a564d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.375720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d95668-b060-4fbe-a02f-74b6d81a564d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:35.378053 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d95668-b060-4fbe-a02f-74b6d81a564d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:35.391022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 470/946] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:35.392150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e972-ad6e-41d3-8678-88d8bf776cf0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-63d95668-b060-4fbe-a02f-74b6d81a564d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:35.393924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:35.394827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:35.396016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 477/947] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Sep 3 01:10:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:35.401337 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d95668-b060-4fbe-a02f-74b6d81a564d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:35.488579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:35.502850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e972-ad6e-41d3-8678-88d8bf776cf0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:35.534435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d95668-b060-4fbe-a02f-74b6d81a564d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:35.538773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72665d-b203-4610-bedd-c9bce241e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:35.539704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72665d-b203-4610-bedd-c9bce241e96d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:35.540174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72665d-b203-4610-bedd-c9bce241e96d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:35.540660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72665d-b203-4610-bedd-c9bce241e96d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.541434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72665d-b203-4610-bedd-c9bce241e96d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:35.542985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72665d-b203-4610-bedd-c9bce241e96d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-eb72665d-b203-4610-bedd-c9bce241e96d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:35.552948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:35.553937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:35.554775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:35.557366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 471/948] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:35.566801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72665d-b203-4610-bedd-c9bce241e96d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:35.573750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a926d00-e079-4ba7-81e2-1459f3a54867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:35.574373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a926d00-e079-4ba7-81e2-1459f3a54867 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:35.574648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a926d00-e079-4ba7-81e2-1459f3a54867 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:35.574919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a926d00-e079-4ba7-81e2-1459f3a54867 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.575731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a926d00-e079-4ba7-81e2-1459f3a54867 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:35.576037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a926d00-e079-4ba7-81e2-1459f3a54867 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:35.577721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a926d00-e079-4ba7-81e2-1459f3a54867 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:35.596412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 478/949] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Sep 3 01:10:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:35.602699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a926d00-e079-4ba7-81e2-1459f3a54867 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:35.628307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:35.693099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72665d-b203-4610-bedd-c9bce241e96d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:35.724247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a926d00-e079-4ba7-81e2-1459f3a54867 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:35.731268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc05403-f1cb-4ae5-a073-08138143a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:35.731893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05403-f1cb-4ae5-a073-08138143a73e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:35.732177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05403-f1cb-4ae5-a073-08138143a73e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:35.732449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05403-f1cb-4ae5-a073-08138143a73e None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.733081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc05403-f1cb-4ae5-a073-08138143a73e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:35.733495 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc05403-f1cb-4ae5-a073-08138143a73e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:35.734857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc05403-f1cb-4ae5-a073-08138143a73e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:35.745176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 472/950] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Sep 3 01:10:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:35.745176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc05403-f1cb-4ae5-a073-08138143a73e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:35.763591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aec8d-3b0a-499b-aaac-7fa0f02cfd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:35.764223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aec8d-3b0a-499b-aaac-7fa0f02cfd54 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:35.764357 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:35.764535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aec8d-3b0a-499b-aaac-7fa0f02cfd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:35.764805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aec8d-3b0a-499b-aaac-7fa0f02cfd54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.775818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1aec8d-3b0a-499b-aaac-7fa0f02cfd54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:35.777328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1aec8d-3b0a-499b-aaac-7fa0f02cfd54 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-8a1aec8d-3b0a-499b-aaac-7fa0f02cfd54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:35.792297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:35.793439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:35.794314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:35.794314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:35.794314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:35.794314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 479/951] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:35.794314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aec8d-3b0a-499b-aaac-7fa0f02cfd54 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:35.857246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc05403-f1cb-4ae5-a073-08138143a73e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:35.870907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:35.893260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c4d8b-efae-438a-b182-e3ed2f6cc7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:35.893820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c4d8b-efae-438a-b182-e3ed2f6cc7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:35.894104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c4d8b-efae-438a-b182-e3ed2f6cc7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:35.894396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c4d8b-efae-438a-b182-e3ed2f6cc7c2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.894981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c4d8b-efae-438a-b182-e3ed2f6cc7c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:35.896378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c4d8b-efae-438a-b182-e3ed2f6cc7c2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:35.903585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aec8d-3b0a-499b-aaac-7fa0f02cfd54 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-761c4d8b-efae-438a-b182-e3ed2f6cc7c2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:35.905270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:35.906269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:35.907101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 473/952] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:35.908563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c4d8b-efae-438a-b182-e3ed2f6cc7c2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:35.948352 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5930d-a8f7-4beb-9d70-b2a6ab1c15d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:35.948966 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5930d-a8f7-4beb-9d70-b2a6ab1c15d6 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:35.949245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5930d-a8f7-4beb-9d70-b2a6ab1c15d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:35.949516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5930d-a8f7-4beb-9d70-b2a6ab1c15d6 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:35.950143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5930d-a8f7-4beb-9d70-b2a6ab1c15d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:35.950444 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5930d-a8f7-4beb-9d70-b2a6ab1c15d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:35.951962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5930d-a8f7-4beb-9d70-b2a6ab1c15d6 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:35.961486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 480/953] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Sep 3 01:10:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:35.961486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5930d-a8f7-4beb-9d70-b2a6ab1c15d6 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:35.998079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:36.019434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c4d8b-efae-438a-b182-e3ed2f6cc7c2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:36.054828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767163cc-3d29-498c-8c3a-f88ff3336300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:36.055476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767163cc-3d29-498c-8c3a-f88ff3336300 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:36.055754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767163cc-3d29-498c-8c3a-f88ff3336300 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:36.056023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767163cc-3d29-498c-8c3a-f88ff3336300 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:36.056670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767163cc-3d29-498c-8c3a-f88ff3336300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:36.056971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767163cc-3d29-498c-8c3a-f88ff3336300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:36.058336 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767163cc-3d29-498c-8c3a-f88ff3336300 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:36.066856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5930d-a8f7-4beb-9d70-b2a6ab1c15d6 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:36.070152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 474/954] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:36.070951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767163cc-3d29-498c-8c3a-f88ff3336300 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:36.103438 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994b305-88e6-4213-999a-dbfcd2ad9c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:36.104361 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994b305-88e6-4213-999a-dbfcd2ad9c2e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:36.104642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994b305-88e6-4213-999a-dbfcd2ad9c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:36.105264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994b305-88e6-4213-999a-dbfcd2ad9c2e None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:36.105882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994b305-88e6-4213-999a-dbfcd2ad9c2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:36.106181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994b305-88e6-4213-999a-dbfcd2ad9c2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:36.107712 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994b305-88e6-4213-999a-dbfcd2ad9c2e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:36.109139 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:36.114365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 481/955] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:36.120508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994b305-88e6-4213-999a-dbfcd2ad9c2e None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:36.177456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767163cc-3d29-498c-8c3a-f88ff3336300 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:36.216392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669810-592c-450c-a03b-35c6f0d5dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:36.217006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669810-592c-450c-a03b-35c6f0d5dbbb None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:36.217285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669810-592c-450c-a03b-35c6f0d5dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:36.217626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669810-592c-450c-a03b-35c6f0d5dbbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:36.218447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02669810-592c-450c-a03b-35c6f0d5dbbb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:36.219852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02669810-592c-450c-a03b-35c6f0d5dbbb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:36.231398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:36.239341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994b305-88e6-4213-999a-dbfcd2ad9c2e None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:36.252646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 475/956] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:10:36 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:36.254243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669810-592c-450c-a03b-35c6f0d5dbbb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:36.292152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c996df4-020a-4454-b534-3bf371ac36fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:36.293397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c996df4-020a-4454-b534-3bf371ac36fb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:36.293969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c996df4-020a-4454-b534-3bf371ac36fb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:36.294332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c996df4-020a-4454-b534-3bf371ac36fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:36.303075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c996df4-020a-4454-b534-3bf371ac36fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:36.304875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c996df4-020a-4454-b534-3bf371ac36fb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-8c996df4-020a-4454-b534-3bf371ac36fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:36.318209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:36.319342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:36.320809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:36.320809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:36.320809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:36.320809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:36.320809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:36.320809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:36.320809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:36.320809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:36.329249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 482/957] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:36.329249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c996df4-020a-4454-b534-3bf371ac36fb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:36.393571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:36.406781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669810-592c-450c-a03b-35c6f0d5dbbb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:36.452204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c996df4-020a-4454-b534-3bf371ac36fb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:36.462707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7d7e5-2a93-41d8-a1e9-f807849218d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:36.463970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7d7e5-2a93-41d8-a1e9-f807849218d9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:36.463970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7d7e5-2a93-41d8-a1e9-f807849218d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:36.464180 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7d7e5-2a93-41d8-a1e9-f807849218d9 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:36.465225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7d7e5-2a93-41d8-a1e9-f807849218d9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:36.465225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7d7e5-2a93-41d8-a1e9-f807849218d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:36.466387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7d7e5-2a93-41d8-a1e9-f807849218d9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:36.472048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 476/958] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:36.492815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd2b20-8cdc-4ba4-b443-181ac7def679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:36.493448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd2b20-8cdc-4ba4-b443-181ac7def679 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:36.493731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd2b20-8cdc-4ba4-b443-181ac7def679 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:36.494004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd2b20-8cdc-4ba4-b443-181ac7def679 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:36.494723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd2b20-8cdc-4ba4-b443-181ac7def679 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:36.495032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd2b20-8cdc-4ba4-b443-181ac7def679 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:36.496617 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd2b20-8cdc-4ba4-b443-181ac7def679 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:36.510728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 483/959] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:36.517307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7d7e5-2a93-41d8-a1e9-f807849218d9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:36.532186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780772e-f466-4a93-beb0-61cb71225f87 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:36.532463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780772e-f466-4a93-beb0-61cb71225f87 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:36.532736 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780772e-f466-4a93-beb0-61cb71225f87 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:36.535624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 484/960] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:36.540169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad2e0-8d6a-441c-a30b-92ccd4ee6bc7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:36.540451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad2e0-8d6a-441c-a30b-92ccd4ee6bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:36.540730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad2e0-8d6a-441c-a30b-92ccd4ee6bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:36.562384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a3cad2e0-8d6a-441c-a30b-92ccd4ee6bc7 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:36.563889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a3cad2e0-8d6a-441c-a30b-92ccd4ee6bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:36.598879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:36.649100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7d7e5-2a93-41d8-a1e9-f807849218d9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:36.655483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 485/961] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:10:36.690500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca496b43-ab00-4149-aea4-3d9c0c5b95ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:36.691600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca496b43-ab00-4149-aea4-3d9c0c5b95ce None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:36.692072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca496b43-ab00-4149-aea4-3d9c0c5b95ce None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:36.692568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca496b43-ab00-4149-aea4-3d9c0c5b95ce None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/4c5af37aaa654585817e3aad0489d323/roles/719d26d82310436eb8ca76e8097c43ec` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:36.695006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca496b43-ab00-4149-aea4-3d9c0c5b95ce None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=4c5af37aaa654585817e3aad0489d323, role_id=719d26d82310436eb8ca76e8097c43ec)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:36.696704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca496b43-ab00-4149-aea4-3d9c0c5b95ce None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:36.716969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 477/962] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:10:36 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/4c5af37aaa654585817e3aad0489d323/roles/719d26d82310436eb8ca76e8097c43ec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:10:36.914958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad2e0-8d6a-441c-a30b-92ccd4ee6bc7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:36.964305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:37.020959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad2e0-8d6a-441c-a30b-92ccd4ee6bc7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:37.055536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:37.056152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:37.056431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:37.056700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:37.057345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:37.058842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:37.061632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: WARNING keystone.server.flask.common [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 03 01:10:37.074790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.sql.core [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 01:10:37.074790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 03 01:10:37.074790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [parameters: {'user_id': 'dad6aee0537844dc8d2dfd988b6da90a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 03 01:10:37.074790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81480) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application conn.query(q) Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application result.read() Sep 03 01:10:37.082308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 01:10:37.083202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application next(self.gen) Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application yield resource Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application next(self.gen) Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self.session.rollback() Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self.force_reraise() Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise self.value Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application session.commit() Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 03 01:10:37.084381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._prepare_impl() Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self.session.flush() Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._flush(objects) Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application compat.raise_( Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application flush_context.execute() Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rec.execute(self) Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 01:10:37.085307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 01:10:37.086219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application conn.query(q) Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application result.read() Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 01:10:37.087068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dad6aee0537844dc8d2dfd988b6da90a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:37.089675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 03 01:10:37.091590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 03 01:10:37.095063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 03 01:10:37.095063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 03 01:10:37.095063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 03 01:10:37.095063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 03 01:10:37.095063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 03 01:10:37.095063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:37.095063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 486/963] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Sep 3 01:10:36 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:37.101348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca496b43-ab00-4149-aea4-3d9c0c5b95ce None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:37.211514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca496b43-ab00-4149-aea4-3d9c0c5b95ce None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:37.233484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:37.249752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d3838-0170-441b-bbd5-c310c363e02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:37.250397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d3838-0170-441b-bbd5-c310c363e02f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:37.250717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d3838-0170-441b-bbd5-c310c363e02f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:37.250987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d3838-0170-441b-bbd5-c310c363e02f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:37.258277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d3838-0170-441b-bbd5-c310c363e02f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:37.259807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d3838-0170-441b-bbd5-c310c363e02f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d93d3838-0170-441b-bbd5-c310c363e02f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:37.271732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:37.272676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:37.273684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:37.273684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:37.273684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:37.273684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:37.273684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:37.273684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:37.273684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:37.273684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:37.273684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 01:10:37.273684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:37.277611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 478/964] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:37.279174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:37.385340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11851cf0-d27b-4f36-a548-8514f3e17d5d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:37.400309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:37.422507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29d998-f178-4414-9a51-c9d02a3b64e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:37.423395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d998-f178-4414-9a51-c9d02a3b64e1 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:37.423736 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d998-f178-4414-9a51-c9d02a3b64e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:37.424291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d998-f178-4414-9a51-c9d02a3b64e1 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:37.425000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29d998-f178-4414-9a51-c9d02a3b64e1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:37.425306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29d998-f178-4414-9a51-c9d02a3b64e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:37.426968 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29d998-f178-4414-9a51-c9d02a3b64e1 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:37.468014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 487/965] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Sep 3 01:10:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:38.288346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a52c-afe5-4cae-8198-0bca92734103 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:38.288914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a52c-afe5-4cae-8198-0bca92734103 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:38.288914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a52c-afe5-4cae-8198-0bca92734103 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:38.290411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 479/966] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:38.296215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a665-e302-4124-af48-688901ca6866 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:38.296474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a665-e302-4124-af48-688901ca6866 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:38.296781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a665-e302-4124-af48-688901ca6866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:38.316115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-c659a665-e302-4124-af48-688901ca6866 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:38.317647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c659a665-e302-4124-af48-688901ca6866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:38.384938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 488/967] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:10:38.427072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f387df3-874c-412a-a4de-a5d5e19d412f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:38.427460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f387df3-874c-412a-a4de-a5d5e19d412f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:38.427809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f387df3-874c-412a-a4de-a5d5e19d412f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:38.431331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 480/968] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:38.434649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed5dc5-7af9-4110-9398-8cabef7ed4d8 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:38.435521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed5dc5-7af9-4110-9398-8cabef7ed4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:38.435998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed5dc5-7af9-4110-9398-8cabef7ed4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:38.456998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7aed5dc5-7af9-4110-9398-8cabef7ed4d8 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:38.458516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7aed5dc5-7af9-4110-9398-8cabef7ed4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:38.527981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 489/969] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:38.658187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f387df3-874c-412a-a4de-a5d5e19d412f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:38.741004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd696-d4f8-4092-9ea9-22cffce250ee None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:38.741215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd696-d4f8-4092-9ea9-22cffce250ee None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:38.741462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd696-d4f8-4092-9ea9-22cffce250ee None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:38.742958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 490/970] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:38.748006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1d4a0-d0c0-4c0b-a20c-62fd00d35c05 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:38.748303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1d4a0-d0c0-4c0b-a20c-62fd00d35c05 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:38.748563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1d4a0-d0c0-4c0b-a20c-62fd00d35c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:38.766933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-31e1d4a0-d0c0-4c0b-a20c-62fd00d35c05 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:38.768171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-31e1d4a0-d0c0-4c0b-a20c-62fd00d35c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:38.768492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f387df3-874c-412a-a4de-a5d5e19d412f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:38.787224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:38.805970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ea092-412a-4689-b9d4-fee458a14854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:38.806615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea092-412a-4689-b9d4-fee458a14854 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:38.806890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea092-412a-4689-b9d4-fee458a14854 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:38.807159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea092-412a-4689-b9d4-fee458a14854 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:38.807771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ea092-412a-4689-b9d4-fee458a14854 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:38.809129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ea092-412a-4689-b9d4-fee458a14854 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-379ea092-412a-4689-b9d4-fee458a14854 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:38.818533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:38.819864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:38.820892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 481/971] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:38.821896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ea092-412a-4689-b9d4-fee458a14854 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:38.842508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 491/972] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:10:38.843395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1d4a0-d0c0-4c0b-a20c-62fd00d35c05 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:38.867718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:38.930083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ea092-412a-4689-b9d4-fee458a14854 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:38.948362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1d4a0-d0c0-4c0b-a20c-62fd00d35c05 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:38.972344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf4a1b-0e75-4150-a6bf-abb293356e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:38.973063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4a1b-0e75-4150-a6bf-abb293356e3a None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:38.973313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4a1b-0e75-4150-a6bf-abb293356e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:38.973783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4a1b-0e75-4150-a6bf-abb293356e3a None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:38.974350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4a1b-0e75-4150-a6bf-abb293356e3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:38.975770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4a1b-0e75-4150-a6bf-abb293356e3a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:38.986185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d63b80-d60b-4de5-90d4-c4c073991a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:38.986892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d63b80-d60b-4de5-90d4-c4c073991a0c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:38.987197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d63b80-d60b-4de5-90d4-c4c073991a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:38.987512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d63b80-d60b-4de5-90d4-c4c073991a0c None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:38.988281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d63b80-d60b-4de5-90d4-c4c073991a0c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:38.988588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d63b80-d60b-4de5-90d4-c4c073991a0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:38.990011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d63b80-d60b-4de5-90d4-c4c073991a0c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:38.993035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 482/973] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:10:38 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:39.000044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 492/974] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Sep 3 01:10:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:39.004446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf4a1b-0e75-4150-a6bf-abb293356e3a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:39.112601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d63b80-d60b-4de5-90d4-c4c073991a0c None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:39.118326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:39.125718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf4a1b-0e75-4150-a6bf-abb293356e3a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:39.133547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:39.167013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94384d43-3098-4143-8a97-8276e8532169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:39.168015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94384d43-3098-4143-8a97-8276e8532169 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:39.168296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94384d43-3098-4143-8a97-8276e8532169 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:39.168565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94384d43-3098-4143-8a97-8276e8532169 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:39.169197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94384d43-3098-4143-8a97-8276e8532169 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:39.169492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94384d43-3098-4143-8a97-8276e8532169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:39.171044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94384d43-3098-4143-8a97-8276e8532169 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:39.176410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 483/975] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Sep 3 01:10:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:39.182400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94384d43-3098-4143-8a97-8276e8532169 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:39.232976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d63b80-d60b-4de5-90d4-c4c073991a0c None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:39.274631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f4ccb-6576-413a-97a3-1ad8386a4f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:39.275558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f4ccb-6576-413a-97a3-1ad8386a4f77 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:39.275839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f4ccb-6576-413a-97a3-1ad8386a4f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:39.276112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f4ccb-6576-413a-97a3-1ad8386a4f77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:39.286469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f4ccb-6576-413a-97a3-1ad8386a4f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:39.291298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94384d43-3098-4143-8a97-8276e8532169 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-f82f4ccb-6576-413a-97a3-1ad8386a4f77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:39.291861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:39.292771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:39.293621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 493/976] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Sep 3 01:10:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:39.299390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f4ccb-6576-413a-97a3-1ad8386a4f77 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:39.334610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb5890-d4f2-4a6f-ab50-a19880623000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:39.335351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb5890-d4f2-4a6f-ab50-a19880623000 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:39.335628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb5890-d4f2-4a6f-ab50-a19880623000 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:39.335901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb5890-d4f2-4a6f-ab50-a19880623000 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:39.336632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb5890-d4f2-4a6f-ab50-a19880623000 None admin] RBAC: Adding query filter params (interface=admin, service_id=c02e374176f54be4a3ac16920be7c53d, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:39.336939 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb5890-d4f2-4a6f-ab50-a19880623000 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:39.338289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb5890-d4f2-4a6f-ab50-a19880623000 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:39.344525 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 484/977] 10.222.0.39 () {56 vars in 1249 bytes} [Sat Sep 3 01:10:39 2022] GET /identity/v3/endpoints?service_id=c02e374176f54be4a3ac16920be7c53d&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:39.350183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb5890-d4f2-4a6f-ab50-a19880623000 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:39.378738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:39.382247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:39.406901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f4ccb-6576-413a-97a3-1ad8386a4f77 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:39.443011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a43188-c986-41b4-a7c7-5dec70177d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:39.443731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a43188-c986-41b4-a7c7-5dec70177d6e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:39.443943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a43188-c986-41b4-a7c7-5dec70177d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:39.444180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a43188-c986-41b4-a7c7-5dec70177d6e None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:39.444842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a43188-c986-41b4-a7c7-5dec70177d6e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:39.445126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a43188-c986-41b4-a7c7-5dec70177d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:39.446495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a43188-c986-41b4-a7c7-5dec70177d6e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:39.459300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 494/978] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Sep 3 01:10:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:39.459499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb5890-d4f2-4a6f-ab50-a19880623000 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:39.462073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a43188-c986-41b4-a7c7-5dec70177d6e None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:39.493837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fc324-7155-4555-8e71-381de6b5bed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:39.494445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fc324-7155-4555-8e71-381de6b5bed5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:39.494719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fc324-7155-4555-8e71-381de6b5bed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:39.494994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fc324-7155-4555-8e71-381de6b5bed5 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:39.495635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fc324-7155-4555-8e71-381de6b5bed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:39.496979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fc324-7155-4555-8e71-381de6b5bed5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:39.504311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 485/979] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Sep 3 01:10:39 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:10:39.579704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a43188-c986-41b4-a7c7-5dec70177d6e None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:39.621529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374743-3b10-4f22-87a2-7bf54db42fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:39.622192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374743-3b10-4f22-87a2-7bf54db42fdf None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:39.622479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374743-3b10-4f22-87a2-7bf54db42fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:39.622753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374743-3b10-4f22-87a2-7bf54db42fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:39.633565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:39.638862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74374743-3b10-4f22-87a2-7bf54db42fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:39.640452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74374743-3b10-4f22-87a2-7bf54db42fdf None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-74374743-3b10-4f22-87a2-7bf54db42fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:39.657176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:39.658204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:39.659111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:39.659111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:39.659111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:39.659111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 495/980] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:39.664587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fc324-7155-4555-8e71-381de6b5bed5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:39.760028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:39.770385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fc324-7155-4555-8e71-381de6b5bed5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:39.804829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec256a-7364-4e52-88a5-6dd888d26596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:39.805445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec256a-7364-4e52-88a5-6dd888d26596 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:39.805722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec256a-7364-4e52-88a5-6dd888d26596 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:39.805995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec256a-7364-4e52-88a5-6dd888d26596 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:39.806647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec256a-7364-4e52-88a5-6dd888d26596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:39.806950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec256a-7364-4e52-88a5-6dd888d26596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:39.808361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec256a-7364-4e52-88a5-6dd888d26596 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:39.820497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 486/981] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:39.826108 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374743-3b10-4f22-87a2-7bf54db42fdf None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:39.928775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374743-3b10-4f22-87a2-7bf54db42fdf None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:39.964110 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c00b-9319-40bc-b6e9-4e94ac346b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:39.964764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c00b-9319-40bc-b6e9-4e94ac346b9f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:39.965040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c00b-9319-40bc-b6e9-4e94ac346b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:39.965312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c00b-9319-40bc-b6e9-4e94ac346b9f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:39.973680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53c00b-9319-40bc-b6e9-4e94ac346b9f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:39.975144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53c00b-9319-40bc-b6e9-4e94ac346b9f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-2b53c00b-9319-40bc-b6e9-4e94ac346b9f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:39.986844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:39.987830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:39.993843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 496/982] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Sep 3 01:10:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:39.994526 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec256a-7364-4e52-88a5-6dd888d26596 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:40.099473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec256a-7364-4e52-88a5-6dd888d26596 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:40.134166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd00d6-6702-4167-9017-19897d23344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:40.134781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd00d6-6702-4167-9017-19897d23344b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:40.135063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd00d6-6702-4167-9017-19897d23344b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:40.135374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd00d6-6702-4167-9017-19897d23344b None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:40.136107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd00d6-6702-4167-9017-19897d23344b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:40.136409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd00d6-6702-4167-9017-19897d23344b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:40.137819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd00d6-6702-4167-9017-19897d23344b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:40.155841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 487/983] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Sep 3 01:10:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:40.161496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c00b-9319-40bc-b6e9-4e94ac346b9f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:40.223657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:40.272390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c00b-9319-40bc-b6e9-4e94ac346b9f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:40.305657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9db57-887f-4851-8073-523404abfd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:40.306258 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9db57-887f-4851-8073-523404abfd8a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:40.306531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9db57-887f-4851-8073-523404abfd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:40.306797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9db57-887f-4851-8073-523404abfd8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:40.373099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9db57-887f-4851-8073-523404abfd8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:40.374700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9db57-887f-4851-8073-523404abfd8a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:40.423911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:40.473746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 497/984] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:40 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:10:40.480098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd00d6-6702-4167-9017-19897d23344b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:40.492525 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:40.586342 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd00d6-6702-4167-9017-19897d23344b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:40.621172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd747e-e9c7-43aa-add4-bd9a3e4a988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:40.621797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd747e-e9c7-43aa-add4-bd9a3e4a988d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:40.622074 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd747e-e9c7-43aa-add4-bd9a3e4a988d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:40.622341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd747e-e9c7-43aa-add4-bd9a3e4a988d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:40.632658 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd747e-e9c7-43aa-add4-bd9a3e4a988d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:40.634093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd747e-e9c7-43aa-add4-bd9a3e4a988d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4ccd747e-e9c7-43aa-add4-bd9a3e4a988d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:40.649126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:40.650088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:40.655764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:40.655764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:40.655764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:40.655764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 488/985] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:40.657801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9db57-887f-4851-8073-523404abfd8a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:40.766262 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9db57-887f-4851-8073-523404abfd8a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:40.802343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167ef10-9967-451b-ac24-0688d0face72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:40.802929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167ef10-9967-451b-ac24-0688d0face72 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:40.803207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167ef10-9967-451b-ac24-0688d0face72 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:40.803499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167ef10-9967-451b-ac24-0688d0face72 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:40.804139 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167ef10-9967-451b-ac24-0688d0face72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:40.804431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167ef10-9967-451b-ac24-0688d0face72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:40.805800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167ef10-9967-451b-ac24-0688d0face72 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:40.822685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 498/986] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:40.824240 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd747e-e9c7-43aa-add4-bd9a3e4a988d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:40.892032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:40.924757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34fa1c-a246-4eab-945b-46786e2315bb None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:40.925379 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34fa1c-a246-4eab-945b-46786e2315bb None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:40.925664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34fa1c-a246-4eab-945b-46786e2315bb None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:40.927328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 499/987] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:40.932082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c1ce5-8c3b-4dc8-95f9-0d5e17525ef5 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:40.932360 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c1ce5-8c3b-4dc8-95f9-0d5e17525ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:40.932630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c1ce5-8c3b-4dc8-95f9-0d5e17525ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:40.934932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd747e-e9c7-43aa-add4-bd9a3e4a988d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:40.953381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0d3c1ce5-8c3b-4dc8-95f9-0d5e17525ef5 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:40.954647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0d3c1ce5-8c3b-4dc8-95f9-0d5e17525ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:40.962767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:40.971487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82a65-4375-47cc-a91d-de9c18e124c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:40.972140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82a65-4375-47cc-a91d-de9c18e124c6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:40.972418 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82a65-4375-47cc-a91d-de9c18e124c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:40.972689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82a65-4375-47cc-a91d-de9c18e124c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:40.980831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d82a65-4375-47cc-a91d-de9c18e124c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:40.982265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d82a65-4375-47cc-a91d-de9c18e124c6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d3d82a65-4375-47cc-a91d-de9c18e124c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:40.994497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:40.995481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:40.996382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:40.996382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:40.996382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:40.996382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:40.996382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:40.996382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:40.996382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:40.996382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:40.996382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 489/988] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:41.001408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82a65-4375-47cc-a91d-de9c18e124c6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:41.034095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 500/989] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:41.106446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82a65-4375-47cc-a91d-de9c18e124c6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:41.129044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:41.141787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707881a9-7799-47bb-a377-94ae292cf6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:41.142398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707881a9-7799-47bb-a377-94ae292cf6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:41.142671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707881a9-7799-47bb-a377-94ae292cf6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:41.142937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707881a9-7799-47bb-a377-94ae292cf6a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:41.143649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707881a9-7799-47bb-a377-94ae292cf6a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:41.143948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707881a9-7799-47bb-a377-94ae292cf6a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:41.145362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707881a9-7799-47bb-a377-94ae292cf6a4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:41.157858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 490/990] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:41.163913 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c1ce5-8c3b-4dc8-95f9-0d5e17525ef5 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:41.271810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c1ce5-8c3b-4dc8-95f9-0d5e17525ef5 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:41.299405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707881a9-7799-47bb-a377-94ae292cf6a4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:41.306205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e3f37-ace2-4a4e-ac91-c63b572b29d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:41.306815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e3f37-ace2-4a4e-ac91-c63b572b29d2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:41.307089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e3f37-ace2-4a4e-ac91-c63b572b29d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:41.307383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e3f37-ace2-4a4e-ac91-c63b572b29d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:41.308103 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e3f37-ace2-4a4e-ac91-c63b572b29d2 None admin] RBAC: Adding query filter params (role.id=719d26d82310436eb8ca76e8097c43ec, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=4c5af37aaa654585817e3aad0489d323) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:41.308425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e3f37-ace2-4a4e-ac91-c63b572b29d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:41.309830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e3f37-ace2-4a4e-ac91-c63b572b29d2 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:41.315793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 501/991] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:41 2022] GET /identity/v3/role_assignments?user.id=4c5af37aaa654585817e3aad0489d323&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=719d26d82310436eb8ca76e8097c43ec => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:41.402877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5df5e-b7c7-41df-b300-6b3bc424b953 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:41.403122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5df5e-b7c7-41df-b300-6b3bc424b953 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:41.403416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5df5e-b7c7-41df-b300-6b3bc424b953 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:41.405067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 502/992] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:41.410505 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872c824-5bfb-4c3c-908f-05d1a34e19f5 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:41.411215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872c824-5bfb-4c3c-908f-05d1a34e19f5 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:41.411735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872c824-5bfb-4c3c-908f-05d1a34e19f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:41.418755 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707881a9-7799-47bb-a377-94ae292cf6a4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:41.425631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:41.431499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b872c824-5bfb-4c3c-908f-05d1a34e19f5 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:41.432828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b872c824-5bfb-4c3c-908f-05d1a34e19f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:41.455786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94834be-78bb-4969-a629-03b63be49563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:41.456505 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94834be-78bb-4969-a629-03b63be49563 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:41.456785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94834be-78bb-4969-a629-03b63be49563 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:41.457055 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94834be-78bb-4969-a629-03b63be49563 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:41.457650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94834be-78bb-4969-a629-03b63be49563 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:41.459025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94834be-78bb-4969-a629-03b63be49563 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b94834be-78bb-4969-a629-03b63be49563 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:41.468280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:41.469361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:41.470195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 491/993] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:41.475483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94834be-78bb-4969-a629-03b63be49563 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:41.518427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 503/994] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:41.535994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:41.591674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94834be-78bb-4969-a629-03b63be49563 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:41.627838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d42b20-c991-4ba1-b998-d4e53dd16101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:41.628444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d42b20-c991-4ba1-b998-d4e53dd16101 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:41.628716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d42b20-c991-4ba1-b998-d4e53dd16101 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:41.628982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d42b20-c991-4ba1-b998-d4e53dd16101 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:41.629602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d42b20-c991-4ba1-b998-d4e53dd16101 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:41.629957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d42b20-c991-4ba1-b998-d4e53dd16101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:41.631348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d42b20-c991-4ba1-b998-d4e53dd16101 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:41.636481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 492/995] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:41.642203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872c824-5bfb-4c3c-908f-05d1a34e19f5 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:41.742768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872c824-5bfb-4c3c-908f-05d1a34e19f5 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:41.777025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd314c31-916c-490a-b36a-743a0a8982e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:41.777628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd314c31-916c-490a-b36a-743a0a8982e1 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:41.777898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd314c31-916c-490a-b36a-743a0a8982e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:41.778146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd314c31-916c-490a-b36a-743a0a8982e1 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:41.778760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd314c31-916c-490a-b36a-743a0a8982e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:41.779053 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd314c31-916c-490a-b36a-743a0a8982e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:41.780703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd314c31-916c-490a-b36a-743a0a8982e1 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:41.782733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:41.786849 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d42b20-c991-4ba1-b998-d4e53dd16101 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:41.787894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 504/996] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:41.792632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd314c31-916c-490a-b36a-743a0a8982e1 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:41.893312 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d42b20-c991-4ba1-b998-d4e53dd16101 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:41.906629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd314c31-916c-490a-b36a-743a0a8982e1 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:41.907436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:41.933671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729c86d-55b4-413b-ab60-a30917b4ab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:41.934621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729c86d-55b4-413b-ab60-a30917b4ab0b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:41.935089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729c86d-55b4-413b-ab60-a30917b4ab0b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:41.935598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729c86d-55b4-413b-ab60-a30917b4ab0b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:41.936470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729c86d-55b4-413b-ab60-a30917b4ab0b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:41.937908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729c86d-55b4-413b-ab60-a30917b4ab0b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:41.941118 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46710f-7084-4000-be6f-5df7c92b23f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:41.941723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46710f-7084-4000-be6f-5df7c92b23f9 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:41.941997 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46710f-7084-4000-be6f-5df7c92b23f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:41.942271 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46710f-7084-4000-be6f-5df7c92b23f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:41.942963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46710f-7084-4000-be6f-5df7c92b23f9 None admin] RBAC: Adding query filter params (interface=public, service_id=d03b53fffe7b4c068291bc48b69e6828, region_id=RegionOne) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:41.943275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46710f-7084-4000-be6f-5df7c92b23f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:41.944640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46710f-7084-4000-be6f-5df7c92b23f9 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f729c86d-55b4-413b-ab60-a30917b4ab0b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:41.949482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:41.950458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 01:10:41.951360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:41.954646 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 505/997] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Sep 3 01:10:41 2022] GET /identity/v3/endpoints?service_id=d03b53fffe7b4c068291bc48b69e6828&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:41.955416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 493/998] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Sep 3 01:10:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:41.955583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46710f-7084-4000-be6f-5df7c92b23f9 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:41.956964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729c86d-55b4-413b-ab60-a30917b4ab0b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:42.023568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:42.061432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46710f-7084-4000-be6f-5df7c92b23f9 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:42.061837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729c86d-55b4-413b-ab60-a30917b4ab0b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:42.096874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4964118-cd42-493d-858d-64541bb87fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:42.097302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655fc5e-74db-4f83-b579-e4826735c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:42.097514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4964118-cd42-493d-858d-64541bb87fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:42.097742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4964118-cd42-493d-858d-64541bb87fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:42.098008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4964118-cd42-493d-858d-64541bb87fd4 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:42.098604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4964118-cd42-493d-858d-64541bb87fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:42.098937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655fc5e-74db-4f83-b579-e4826735c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:42.099450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655fc5e-74db-4f83-b579-e4826735c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:42.099910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655fc5e-74db-4f83-b579-e4826735c7b5 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:42.100026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4964118-cd42-493d-858d-64541bb87fd4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:42.100989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655fc5e-74db-4f83-b579-e4826735c7b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:42.101760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655fc5e-74db-4f83-b579-e4826735c7b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:42.103602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655fc5e-74db-4f83-b579-e4826735c7b5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:42.106419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 506/999] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Sep 3 01:10:41 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:10:42.109311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 494/1000] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Sep 3 01:10:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:42.115167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4964118-cd42-493d-858d-64541bb87fd4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:42.230030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4964118-cd42-493d-858d-64541bb87fd4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:42.258575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:42.268267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d1fe7-9b8c-4c52-99a3-5184e1e3ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:42.268952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1fe7-9b8c-4c52-99a3-5184e1e3ac93 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:42.269228 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1fe7-9b8c-4c52-99a3-5184e1e3ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:42.269497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1fe7-9b8c-4c52-99a3-5184e1e3ac93 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:42.270130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1fe7-9b8c-4c52-99a3-5184e1e3ac93 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:42.270426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1fe7-9b8c-4c52-99a3-5184e1e3ac93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:42.271853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1fe7-9b8c-4c52-99a3-5184e1e3ac93 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:42.277102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 507/1001] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Sep 3 01:10:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:42.283042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655fc5e-74db-4f83-b579-e4826735c7b5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:42.324895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:42.387174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655fc5e-74db-4f83-b579-e4826735c7b5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:42.421762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d0cf7-e0f0-4b66-a3e1-d302698ebe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:42.422462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0cf7-e0f0-4b66-a3e1-d302698ebe3d None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:42.422742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0cf7-e0f0-4b66-a3e1-d302698ebe3d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:42.423063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0cf7-e0f0-4b66-a3e1-d302698ebe3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:42.423800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d0cf7-e0f0-4b66-a3e1-d302698ebe3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:42.425182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d0cf7-e0f0-4b66-a3e1-d302698ebe3d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:42.443381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 495/1002] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:10:42 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:43.254418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148351c-b18a-4c82-aa57-ebe7eec5b719 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:43.254980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148351c-b18a-4c82-aa57-ebe7eec5b719 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:43.254980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148351c-b18a-4c82-aa57-ebe7eec5b719 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:43.256511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 508/1003] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:43.261582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd741465-9dfd-46c4-b531-71c8a1d37bc3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:43.261984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd741465-9dfd-46c4-b531-71c8a1d37bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:43.262168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd741465-9dfd-46c4-b531-71c8a1d37bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:43.281081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bd741465-9dfd-46c4-b531-71c8a1d37bc3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:43.282283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bd741465-9dfd-46c4-b531-71c8a1d37bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:43.356184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 496/1004] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:43.620186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148351c-b18a-4c82-aa57-ebe7eec5b719 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:43.721334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148351c-b18a-4c82-aa57-ebe7eec5b719 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:43.766395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2ca91-e90d-4696-a5c0-b2394c35ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:43.767032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2ca91-e90d-4696-a5c0-b2394c35ef3e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:43.767341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2ca91-e90d-4696-a5c0-b2394c35ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:43.767605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2ca91-e90d-4696-a5c0-b2394c35ef3e None admin] PATH_INFO: `/v3/services/image` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:43.768185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2ca91-e90d-4696-a5c0-b2394c35ef3e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:43.769540 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2ca91-e90d-4696-a5c0-b2394c35ef3e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-74b2ca91-e90d-4696-a5c0-b2394c35ef3e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:43.778662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:43.779752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 01:10:43.780849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:43.783646 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 509/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Sep 3 01:10:43 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:43.785998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd741465-9dfd-46c4-b531-71c8a1d37bc3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:43.813566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:43.894188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd741465-9dfd-46c4-b531-71c8a1d37bc3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:43.929919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe5f32-4a35-4e2b-b0a1-34cd48eaaf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:43.930536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe5f32-4a35-4e2b-b0a1-34cd48eaaf84 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:43.930813 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe5f32-4a35-4e2b-b0a1-34cd48eaaf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:43.931082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe5f32-4a35-4e2b-b0a1-34cd48eaaf84 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:43.931746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe5f32-4a35-4e2b-b0a1-34cd48eaaf84 None admin] RBAC: Adding query filter params (name=image) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:43.932040 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe5f32-4a35-4e2b-b0a1-34cd48eaaf84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:43.933404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe5f32-4a35-4e2b-b0a1-34cd48eaaf84 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:43.939022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 497/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:43.944551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2ca91-e90d-4696-a5c0-b2394c35ef3e None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:44.002084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:44.046762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2ca91-e90d-4696-a5c0-b2394c35ef3e None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:44.049948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bbc60-5a53-411f-b8f9-812e5f325373 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:44.050300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bbc60-5a53-411f-b8f9-812e5f325373 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:44.050636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bbc60-5a53-411f-b8f9-812e5f325373 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:44.052255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 498/1007] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:44.058077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb0d8e-5dbe-47df-a79c-4a3e24db17f0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:44.058330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb0d8e-5dbe-47df-a79c-4a3e24db17f0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:44.058605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb0d8e-5dbe-47df-a79c-4a3e24db17f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:44.077723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-beeb0d8e-5dbe-47df-a79c-4a3e24db17f0 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:44.078927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-beeb0d8e-5dbe-47df-a79c-4a3e24db17f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:44.084594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e6925-8264-47c1-b8bc-d08212a56673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:44.085217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6925-8264-47c1-b8bc-d08212a56673 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:44.085501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6925-8264-47c1-b8bc-d08212a56673 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:44.085770 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6925-8264-47c1-b8bc-d08212a56673 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:44.086404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e6925-8264-47c1-b8bc-d08212a56673 None admin] RBAC: Adding query filter params (type=image) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:44.086700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e6925-8264-47c1-b8bc-d08212a56673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:44.088185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e6925-8264-47c1-b8bc-d08212a56673 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:44.103284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 510/1008] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:44.167727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 499/1009] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:44.329741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165b287-b2d7-42bb-a499-02eb085030b8 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:44.330278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165b287-b2d7-42bb-a499-02eb085030b8 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:44.330278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165b287-b2d7-42bb-a499-02eb085030b8 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:44.331820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 511/1010] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:44.337021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181625a-2407-4848-a42e-eda9a1c0fd80 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:44.337435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181625a-2407-4848-a42e-eda9a1c0fd80 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:44.337511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181625a-2407-4848-a42e-eda9a1c0fd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:44.356597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a181625a-2407-4848-a42e-eda9a1c0fd80 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:44.357832 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a181625a-2407-4848-a42e-eda9a1c0fd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:44.371920 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:44.428659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 500/1011] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:44.438438 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165b287-b2d7-42bb-a499-02eb085030b8 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:44.544486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165b287-b2d7-42bb-a499-02eb085030b8 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:44.566410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:44.582120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2bfec-adcc-4422-b9fe-15c3351b7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:44.582753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2bfec-adcc-4422-b9fe-15c3351b7535 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:44.583031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2bfec-adcc-4422-b9fe-15c3351b7535 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:44.583329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2bfec-adcc-4422-b9fe-15c3351b7535 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:44.583916 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2bfec-adcc-4422-b9fe-15c3351b7535 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:44.585286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2bfec-adcc-4422-b9fe-15c3351b7535 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-68b2bfec-adcc-4422-b9fe-15c3351b7535 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:44.594383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:44.595581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 01:10:44.596624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:44.600342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 512/1012] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:44.601667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181625a-2407-4848-a42e-eda9a1c0fd80 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:44.691120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2bfec-adcc-4422-b9fe-15c3351b7535 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:44.706824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181625a-2407-4848-a42e-eda9a1c0fd80 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:44.744428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6826e2-703d-41f1-a590-32c7cf3aec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:44.745068 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6826e2-703d-41f1-a590-32c7cf3aec5b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:44.745341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6826e2-703d-41f1-a590-32c7cf3aec5b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:44.745608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6826e2-703d-41f1-a590-32c7cf3aec5b None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:44.746232 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6826e2-703d-41f1-a590-32c7cf3aec5b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:44.746528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6826e2-703d-41f1-a590-32c7cf3aec5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:44.747910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6826e2-703d-41f1-a590-32c7cf3aec5b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:44.752877 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 501/1013] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:44.758245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6826e2-703d-41f1-a590-32c7cf3aec5b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:44.772450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:44.801544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2bfec-adcc-4422-b9fe-15c3351b7535 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:44.835376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47224390-ad50-40b9-9cd7-9c1f5edb15fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:44.836161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47224390-ad50-40b9-9cd7-9c1f5edb15fb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:44.836443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47224390-ad50-40b9-9cd7-9c1f5edb15fb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:44.836715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47224390-ad50-40b9-9cd7-9c1f5edb15fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:44.837807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47224390-ad50-40b9-9cd7-9c1f5edb15fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:44.839291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47224390-ad50-40b9-9cd7-9c1f5edb15fb None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:44.841034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 513/1014] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:44.846594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47224390-ad50-40b9-9cd7-9c1f5edb15fb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:44.858227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6826e2-703d-41f1-a590-32c7cf3aec5b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:44.901490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8b4ce-39d0-44df-86ad-fcb3012940d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:44.902293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8b4ce-39d0-44df-86ad-fcb3012940d3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:44.902427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8b4ce-39d0-44df-86ad-fcb3012940d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:44.902665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8b4ce-39d0-44df-86ad-fcb3012940d3 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:44.903324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8b4ce-39d0-44df-86ad-fcb3012940d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:44.903626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8b4ce-39d0-44df-86ad-fcb3012940d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:44.905123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8b4ce-39d0-44df-86ad-fcb3012940d3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:44.909563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:44.914908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 502/1015] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Sep 3 01:10:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:44.915785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8b4ce-39d0-44df-86ad-fcb3012940d3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:44.960286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47224390-ad50-40b9-9cd7-9c1f5edb15fb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:44.992320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:44.995582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1f620-4684-47b6-ae55-84c76c6e4daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:44.996223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1f620-4684-47b6-ae55-84c76c6e4daf None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:44.996808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1f620-4684-47b6-ae55-84c76c6e4daf None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:44.997374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1f620-4684-47b6-ae55-84c76c6e4daf None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:44.998219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1f620-4684-47b6-ae55-84c76c6e4daf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:44.999894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1f620-4684-47b6-ae55-84c76c6e4daf None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:45.015974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8b4ce-39d0-44df-86ad-fcb3012940d3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:45.031333 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 514/1016] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:10:44 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:10:45.054527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ca52-9dcb-4341-bb5e-2e37fe96af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:45.055236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ca52-9dcb-4341-bb5e-2e37fe96af2f None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:45.055545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ca52-9dcb-4341-bb5e-2e37fe96af2f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:45.055818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ca52-9dcb-4341-bb5e-2e37fe96af2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:45.056517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89ca52-9dcb-4341-bb5e-2e37fe96af2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:45.057998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89ca52-9dcb-4341-bb5e-2e37fe96af2f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:45.091281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 503/1017] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:10:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:46.030130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0b81e-b0f5-4ffb-a93f-bdb2b3c5fc6d None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:46.030678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0b81e-b0f5-4ffb-a93f-bdb2b3c5fc6d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:46.030678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0b81e-b0f5-4ffb-a93f-bdb2b3c5fc6d None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:46.032166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 515/1018] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:46.037685 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5022cb-1c4b-4ecc-a3db-f6bc50908968 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:46.038125 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5022cb-1c4b-4ecc-a3db-f6bc50908968 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:46.038212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5022cb-1c4b-4ecc-a3db-f6bc50908968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:46.057659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4e5022cb-1c4b-4ecc-a3db-f6bc50908968 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:46.058855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4e5022cb-1c4b-4ecc-a3db-f6bc50908968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:46.133508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 504/1019] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:46 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:46.400868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0b81e-b0f5-4ffb-a93f-bdb2b3c5fc6d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:46.504319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0b81e-b0f5-4ffb-a93f-bdb2b3c5fc6d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:46.506816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:46.540697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40f191-45d4-443e-9099-0e980cca59a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:46.541312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40f191-45d4-443e-9099-0e980cca59a0 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:46.541588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40f191-45d4-443e-9099-0e980cca59a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:46.541855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40f191-45d4-443e-9099-0e980cca59a0 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:46.542508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40f191-45d4-443e-9099-0e980cca59a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:46.543974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40f191-45d4-443e-9099-0e980cca59a0 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:46.564436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 516/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:10:46 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:46.989808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6cee-8e08-4ad7-8ef3-cde0efaae3f4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:46.990187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6cee-8e08-4ad7-8ef3-cde0efaae3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:46.990360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6cee-8e08-4ad7-8ef3-cde0efaae3f4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:46.991793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 505/1021] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:46.997123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b061dcd-4acc-4df5-9b22-1d6bfbec8467 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:46.997381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b061dcd-4acc-4df5-9b22-1d6bfbec8467 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:46.997683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b061dcd-4acc-4df5-9b22-1d6bfbec8467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:47.016459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8b061dcd-4acc-4df5-9b22-1d6bfbec8467 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:47.017419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8b061dcd-4acc-4df5-9b22-1d6bfbec8467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:47.093703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 517/1022] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:10:47.102161 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be5ec-d754-4b59-90ba-64d41e24a70b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:47.102543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be5ec-d754-4b59-90ba-64d41e24a70b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:47.102696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be5ec-d754-4b59-90ba-64d41e24a70b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:47.104244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 506/1023] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:47.110083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905dda8-5e3e-4777-a3f4-2f5c492a99cb None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:47.110374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905dda8-5e3e-4777-a3f4-2f5c492a99cb None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:47.110650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905dda8-5e3e-4777-a3f4-2f5c492a99cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:47.129948 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2905dda8-5e3e-4777-a3f4-2f5c492a99cb None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:47.131150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2905dda8-5e3e-4777-a3f4-2f5c492a99cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:47.208199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 518/1024] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:47.359686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3be5ec-d754-4b59-90ba-64d41e24a70b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:47.422159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:47.468095 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3be5ec-d754-4b59-90ba-64d41e24a70b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:47.471695 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905dda8-5e3e-4777-a3f4-2f5c492a99cb None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:47.495537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:47.504914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76060440-21af-4b54-8b46-e7dbaf81620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:47.505548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76060440-21af-4b54-8b46-e7dbaf81620d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:47.505847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76060440-21af-4b54-8b46-e7dbaf81620d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:47.506088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76060440-21af-4b54-8b46-e7dbaf81620d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:47.507488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76060440-21af-4b54-8b46-e7dbaf81620d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:47.508850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76060440-21af-4b54-8b46-e7dbaf81620d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:47.510582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 507/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:47.516110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76060440-21af-4b54-8b46-e7dbaf81620d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:47.579862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905dda8-5e3e-4777-a3f4-2f5c492a99cb None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:47.618286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556c5ec-8d7b-4f59-934b-89567497fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:47.618836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556c5ec-8d7b-4f59-934b-89567497fb1f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:47.619115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556c5ec-8d7b-4f59-934b-89567497fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:47.619431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556c5ec-8d7b-4f59-934b-89567497fb1f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:47.619900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76060440-21af-4b54-8b46-e7dbaf81620d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:47.630344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556c5ec-8d7b-4f59-934b-89567497fb1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-4556c5ec-8d7b-4f59-934b-89567497fb1f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:47.636080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:47.637324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:47.638377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:47.641389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 519/1026] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Sep 3 01:10:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:47.648101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556c5ec-8d7b-4f59-934b-89567497fb1f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:47.652789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:47.663423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64241800-9a78-4f73-9fa2-aacf4e4d7be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:47.664163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64241800-9a78-4f73-9fa2-aacf4e4d7be6 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:47.664442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64241800-9a78-4f73-9fa2-aacf4e4d7be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:47.665086 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64241800-9a78-4f73-9fa2-aacf4e4d7be6 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:47.666006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64241800-9a78-4f73-9fa2-aacf4e4d7be6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:47.667882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64241800-9a78-4f73-9fa2-aacf4e4d7be6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:47.696439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 508/1027] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:10:47 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:10:47.747924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:47.771143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556c5ec-8d7b-4f59-934b-89567497fb1f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:47.808197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a8d15-e065-4ccf-8e62-a957277ac9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:47.808825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a8d15-e065-4ccf-8e62-a957277ac9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:47.809106 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a8d15-e065-4ccf-8e62-a957277ac9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:47.809376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a8d15-e065-4ccf-8e62-a957277ac9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:47.810049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a8d15-e065-4ccf-8e62-a957277ac9b2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:47.810350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a8d15-e065-4ccf-8e62-a957277ac9b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:47.812266 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a8d15-e065-4ccf-8e62-a957277ac9b2 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:47.821459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 520/1028] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Sep 3 01:10:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:47.829817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64241800-9a78-4f73-9fa2-aacf4e4d7be6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:47.934459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64241800-9a78-4f73-9fa2-aacf4e4d7be6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:47.969100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caad94-7b96-48ab-a6e3-b15e0a3568be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:47.969750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caad94-7b96-48ab-a6e3-b15e0a3568be None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:47.970027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caad94-7b96-48ab-a6e3-b15e0a3568be None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:47.970298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caad94-7b96-48ab-a6e3-b15e0a3568be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:47.982237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caad94-7b96-48ab-a6e3-b15e0a3568be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:47.984045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caad94-7b96-48ab-a6e3-b15e0a3568be None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f4caad94-7b96-48ab-a6e3-b15e0a3568be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:47.998857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:48.000087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:48.001019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:48.001019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:48.001019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:48.001019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 509/1029] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:48.006005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a8d15-e065-4ccf-8e62-a957277ac9b2 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:48.107879 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a8d15-e065-4ccf-8e62-a957277ac9b2 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:48.141119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68f95-6970-4a79-92de-4f3018155ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:48.141742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68f95-6970-4a79-92de-4f3018155ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:48.142014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68f95-6970-4a79-92de-4f3018155ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:48.142283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68f95-6970-4a79-92de-4f3018155ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:48.142903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee68f95-6970-4a79-92de-4f3018155ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:48.143198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee68f95-6970-4a79-92de-4f3018155ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:48.144588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee68f95-6970-4a79-92de-4f3018155ca4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:48.156830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 521/1030] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:48.162503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caad94-7b96-48ab-a6e3-b15e0a3568be None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:48.206566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:48.273945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caad94-7b96-48ab-a6e3-b15e0a3568be None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:48.308309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e812b-d680-4350-8117-bd790580ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:48.308936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e812b-d680-4350-8117-bd790580ed2a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:48.309212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e812b-d680-4350-8117-bd790580ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:48.309475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e812b-d680-4350-8117-bd790580ed2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:48.316967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e812b-d680-4350-8117-bd790580ed2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:48.318400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e812b-d680-4350-8117-bd790580ed2a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d00e812b-d680-4350-8117-bd790580ed2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:48.330369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:48.331364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:48.332318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:48.332318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:48.332318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:48.332318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:48.332318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:48.332318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:48.332318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:48.332318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:48.332318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:48.332318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:48.335339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 510/1031] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Sep 3 01:10:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:48.337658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68f95-6970-4a79-92de-4f3018155ca4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:48.340651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:48.445530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68f95-6970-4a79-92de-4f3018155ca4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:48.470139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298bdf1-6ac3-4bf2-aad1-fd3afcb61f12 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:48.470721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298bdf1-6ac3-4bf2-aad1-fd3afcb61f12 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:48.471005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298bdf1-6ac3-4bf2-aad1-fd3afcb61f12 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:48.472837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 511/1032] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:48.477346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a856a1-33c8-4c52-81c4-e9d87b7728f2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:48.477633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a856a1-33c8-4c52-81c4-e9d87b7728f2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:48.477880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a856a1-33c8-4c52-81c4-e9d87b7728f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:48.484548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9ac17-d890-4a82-8ea7-364cef4e4467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:48.485167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9ac17-d890-4a82-8ea7-364cef4e4467 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:48.486269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9ac17-d890-4a82-8ea7-364cef4e4467 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:48.486544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9ac17-d890-4a82-8ea7-364cef4e4467 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:48.487317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9ac17-d890-4a82-8ea7-364cef4e4467 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:48.487611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9ac17-d890-4a82-8ea7-364cef4e4467 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:48.489043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9ac17-d890-4a82-8ea7-364cef4e4467 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:48.497128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-62a856a1-33c8-4c52-81c4-e9d87b7728f2 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:48.498393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-62a856a1-33c8-4c52-81c4-e9d87b7728f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:48.511855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 522/1033] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Sep 3 01:10:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:48.512900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9ac17-d890-4a82-8ea7-364cef4e4467 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:48.574220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:48.582916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 512/1034] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:10:48.618985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9ac17-d890-4a82-8ea7-364cef4e4467 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:48.654461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292860-785b-4055-bf79-93e5ef391154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:48.655063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292860-785b-4055-bf79-93e5ef391154 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:48.655384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292860-785b-4055-bf79-93e5ef391154 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:48.655619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292860-785b-4055-bf79-93e5ef391154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:48.721917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9292860-785b-4055-bf79-93e5ef391154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:48.723282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9292860-785b-4055-bf79-93e5ef391154 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:48.779306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:48.820137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 523/1035] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:48 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 03 01:10:48.825985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a856a1-33c8-4c52-81c4-e9d87b7728f2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:48.842233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292860-785b-4055-bf79-93e5ef391154 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:48.856774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:48.942764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a856a1-33c8-4c52-81c4-e9d87b7728f2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:48.946729 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292860-785b-4055-bf79-93e5ef391154 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:48.979977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6bfc8-c9d4-46f2-9fbd-e02524f58ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:48.980544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6bfc8-c9d4-46f2-9fbd-e02524f58ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:48.980816 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6bfc8-c9d4-46f2-9fbd-e02524f58ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:48.981077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6bfc8-c9d4-46f2-9fbd-e02524f58ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:48.983060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72333ae-3a56-4a46-801a-a88a229e8512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:48.983719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72333ae-3a56-4a46-801a-a88a229e8512 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:48.984008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72333ae-3a56-4a46-801a-a88a229e8512 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:48.984275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72333ae-3a56-4a46-801a-a88a229e8512 None admin] PATH_INFO: `/v3/services/image` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:48.984846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72333ae-3a56-4a46-801a-a88a229e8512 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:48.986199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72333ae-3a56-4a46-801a-a88a229e8512 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:48.991465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6bfc8-c9d4-46f2-9fbd-e02524f58ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:48.992894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6bfc8-c9d4-46f2-9fbd-e02524f58ad2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-c72333ae-3a56-4a46-801a-a88a229e8512 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:48.994848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:48.995874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 01:10:48.996728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:49.001435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 524/1036] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Sep 3 01:10:48 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:49.002308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72333ae-3a56-4a46-801a-a88a229e8512 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0ee6bfc8-c9d4-46f2-9fbd-e02524f58ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:49.010569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:49.011640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:49.012533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:49.012533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:49.012533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:49.012533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 513/1037] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:49.017354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6bfc8-c9d4-46f2-9fbd-e02524f58ad2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:49.030936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:49.095908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:49.110875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72333ae-3a56-4a46-801a-a88a229e8512 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:49.120082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6bfc8-c9d4-46f2-9fbd-e02524f58ad2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:49.144439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266285af-3810-4690-b3e0-d86a1d56ee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:49.145049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266285af-3810-4690-b3e0-d86a1d56ee47 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:49.145334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266285af-3810-4690-b3e0-d86a1d56ee47 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:49.145599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266285af-3810-4690-b3e0-d86a1d56ee47 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:49.146222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266285af-3810-4690-b3e0-d86a1d56ee47 None admin] RBAC: Adding query filter params (name=image) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:49.146521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266285af-3810-4690-b3e0-d86a1d56ee47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:49.147930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266285af-3810-4690-b3e0-d86a1d56ee47 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:49.158016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 525/1038] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:49.158903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3758f-5dc5-46aa-af3f-e68ba3423a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:49.159458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266285af-3810-4690-b3e0-d86a1d56ee47 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:49.159577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3758f-5dc5-46aa-af3f-e68ba3423a86 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:49.159809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3758f-5dc5-46aa-af3f-e68ba3423a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:49.160078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3758f-5dc5-46aa-af3f-e68ba3423a86 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:49.160725 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3758f-5dc5-46aa-af3f-e68ba3423a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:49.161023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3758f-5dc5-46aa-af3f-e68ba3423a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:49.162363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3758f-5dc5-46aa-af3f-e68ba3423a86 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:49.179090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 514/1039] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:49.180115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3758f-5dc5-46aa-af3f-e68ba3423a86 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:49.267854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:49.282029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266285af-3810-4690-b3e0-d86a1d56ee47 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:49.307098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3758f-5dc5-46aa-af3f-e68ba3423a86 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:49.321005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c39add-757b-477d-be81-d0c133ae273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:49.321919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c39add-757b-477d-be81-d0c133ae273a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:49.322335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c39add-757b-477d-be81-d0c133ae273a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:49.322770 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c39add-757b-477d-be81-d0c133ae273a None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:49.323556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c39add-757b-477d-be81-d0c133ae273a None admin] RBAC: Adding query filter params (type=image) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:49.324070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c39add-757b-477d-be81-d0c133ae273a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:49.325687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c39add-757b-477d-be81-d0c133ae273a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:49.331838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 526/1040] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:49.337312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c39add-757b-477d-be81-d0c133ae273a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:49.349829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46892e1-ba85-4c95-bb5f-6301040de8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:49.350819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46892e1-ba85-4c95-bb5f-6301040de8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:49.351096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46892e1-ba85-4c95-bb5f-6301040de8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:49.351398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46892e1-ba85-4c95-bb5f-6301040de8e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:49.355285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:49.360687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46892e1-ba85-4c95-bb5f-6301040de8e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:49.362285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46892e1-ba85-4c95-bb5f-6301040de8e4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e46892e1-ba85-4c95-bb5f-6301040de8e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:49.374229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:49.375165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:49.376104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:49.376104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:49.376104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:49.376104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:49.376104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:49.376104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:49.376104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:49.376104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:49.376104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 515/1041] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:49.381218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46892e1-ba85-4c95-bb5f-6301040de8e4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:49.446506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c39add-757b-477d-be81-d0c133ae273a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:49.480430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bf7ba-1648-42b2-88c8-0b6d9138862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:49.481034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf7ba-1648-42b2-88c8-0b6d9138862d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:49.481307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf7ba-1648-42b2-88c8-0b6d9138862d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:49.481575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf7ba-1648-42b2-88c8-0b6d9138862d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:49.482267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bf7ba-1648-42b2-88c8-0b6d9138862d None admin] RBAC: Adding query filter params (interface=public, service_id=e9d1df42d2fe4ed899ff5c084178c014, region_id=RegionOne) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:49.482685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bf7ba-1648-42b2-88c8-0b6d9138862d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:49.484085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bf7ba-1648-42b2-88c8-0b6d9138862d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:49.489098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 527/1042] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Sep 3 01:10:49 2022] GET /identity/v3/endpoints?service_id=e9d1df42d2fe4ed899ff5c084178c014&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:49.490824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46892e1-ba85-4c95-bb5f-6301040de8e4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:49.494710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bf7ba-1648-42b2-88c8-0b6d9138862d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:49.513494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:49.529306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2652d-5cd2-4ee9-b9ae-aa317ee9de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:49.529924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2652d-5cd2-4ee9-b9ae-aa317ee9de3e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:49.530243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2652d-5cd2-4ee9-b9ae-aa317ee9de3e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:49.530582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2652d-5cd2-4ee9-b9ae-aa317ee9de3e None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:49.531555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2652d-5cd2-4ee9-b9ae-aa317ee9de3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:49.531753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2652d-5cd2-4ee9-b9ae-aa317ee9de3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:49.536899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2652d-5cd2-4ee9-b9ae-aa317ee9de3e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:49.556051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 516/1043] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:49.558595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2652d-5cd2-4ee9-b9ae-aa317ee9de3e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:49.602717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bf7ba-1648-42b2-88c8-0b6d9138862d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:49.620116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:49.639134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45594c-004a-4c71-bde2-08fb0def03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:49.639765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45594c-004a-4c71-bde2-08fb0def03f2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:49.640042 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45594c-004a-4c71-bde2-08fb0def03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:49.640310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45594c-004a-4c71-bde2-08fb0def03f2 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:49.640906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45594c-004a-4c71-bde2-08fb0def03f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:49.642262 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45594c-004a-4c71-bde2-08fb0def03f2 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:49.659302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 528/1044] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Sep 3 01:10:49 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:10:49.670180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38b83-a906-42b5-bc8b-10ac16389419 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:49.670599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38b83-a906-42b5-bc8b-10ac16389419 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:49.670936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38b83-a906-42b5-bc8b-10ac16389419 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:49.672608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 529/1045] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:49.678543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4a257-6368-4701-b4ec-6db9473cd944 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:49.679068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4a257-6368-4701-b4ec-6db9473cd944 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:49.679381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4a257-6368-4701-b4ec-6db9473cd944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:49.682714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2652d-5cd2-4ee9-b9ae-aa317ee9de3e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:49.697849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2ba4a257-6368-4701-b4ec-6db9473cd944 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:49.699065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2ba4a257-6368-4701-b4ec-6db9473cd944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:49.721679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc0cfb-99ba-4c15-9dd5-4e39e1496eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:49.722310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc0cfb-99ba-4c15-9dd5-4e39e1496eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:49.722587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc0cfb-99ba-4c15-9dd5-4e39e1496eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:49.722856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc0cfb-99ba-4c15-9dd5-4e39e1496eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:49.723627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc0cfb-99ba-4c15-9dd5-4e39e1496eb9 None admin] RBAC: Adding query filter params (role.id=719d26d82310436eb8ca76e8097c43ec, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=9c4076fd5abc4b508a0215ce22af85d6) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:49.723932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc0cfb-99ba-4c15-9dd5-4e39e1496eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:49.725372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc0cfb-99ba-4c15-9dd5-4e39e1496eb9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:49.739297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 517/1046] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:49 2022] GET /identity/v3/role_assignments?user.id=9c4076fd5abc4b508a0215ce22af85d6&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=719d26d82310436eb8ca76e8097c43ec => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:49.786884 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 530/1047] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:10:50.050457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc0cfb-99ba-4c15-9dd5-4e39e1496eb9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:50.159733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc0cfb-99ba-4c15-9dd5-4e39e1496eb9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:50.185855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:50.205560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae6ada-6341-467d-aed9-09fd4f551833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:50.206201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae6ada-6341-467d-aed9-09fd4f551833 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:50.206475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae6ada-6341-467d-aed9-09fd4f551833 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:50.206744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae6ada-6341-467d-aed9-09fd4f551833 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:50.216756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae6ada-6341-467d-aed9-09fd4f551833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-98ae6ada-6341-467d-aed9-09fd4f551833 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:50.222062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:50.222981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:50.223872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 518/1048] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:50.229762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4a257-6368-4701-b4ec-6db9473cd944 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:50.241958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:50.330682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4a257-6368-4701-b4ec-6db9473cd944 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:50.364354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52b27b-1f2b-4a02-bd12-0c8b077b419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:50.364975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52b27b-1f2b-4a02-bd12-0c8b077b419b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:50.365234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52b27b-1f2b-4a02-bd12-0c8b077b419b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:50.365490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52b27b-1f2b-4a02-bd12-0c8b077b419b None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:50.366152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52b27b-1f2b-4a02-bd12-0c8b077b419b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:50.366445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52b27b-1f2b-4a02-bd12-0c8b077b419b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:50.367848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52b27b-1f2b-4a02-bd12-0c8b077b419b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:50.376355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 531/1049] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:50.382006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae6ada-6341-467d-aed9-09fd4f551833 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:50.484174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae6ada-6341-467d-aed9-09fd4f551833 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:50.518906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b6495-d3aa-454d-b00c-c187c6030c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:50.519883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b6495-d3aa-454d-b00c-c187c6030c2e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:50.520358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b6495-d3aa-454d-b00c-c187c6030c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:50.520882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b6495-d3aa-454d-b00c-c187c6030c2e None admin] PATH_INFO: `/v3/users/a8840e1a6e0a4b60b556880bc03a03a8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:50.534651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b6495-d3aa-454d-b00c-c187c6030c2e None admin] RBAC: Authorizing `identity:get_user(user_id=a8840e1a6e0a4b60b556880bc03a03a8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:50.536362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b6495-d3aa-454d-b00c-c187c6030c2e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:50.538498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 519/1050] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:10:50 2022] GET /identity/v3/users/a8840e1a6e0a4b60b556880bc03a03a8 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:50.544160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52b27b-1f2b-4a02-bd12-0c8b077b419b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:50.618228 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:50.649231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52b27b-1f2b-4a02-bd12-0c8b077b419b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:50.684150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b976a1-9a35-4936-9121-70f9e6fe3242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:50.684758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b976a1-9a35-4936-9121-70f9e6fe3242 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:50.685038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b976a1-9a35-4936-9121-70f9e6fe3242 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:50.685302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b976a1-9a35-4936-9121-70f9e6fe3242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:50.759855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b976a1-9a35-4936-9121-70f9e6fe3242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:50.761322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b976a1-9a35-4936-9121-70f9e6fe3242 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:50.831434 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:50.869059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 532/1051] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:10:50.870242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b6495-d3aa-454d-b00c-c187c6030c2e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:50.910153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:50.970765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b6495-d3aa-454d-b00c-c187c6030c2e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:51.006654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa819e-6828-428d-8ba7-094fb867da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:51.007364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa819e-6828-428d-8ba7-094fb867da9a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:51.007643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa819e-6828-428d-8ba7-094fb867da9a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:51.007913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa819e-6828-428d-8ba7-094fb867da9a None admin] PATH_INFO: `/v3/projects/8d9e5a32df2546e385f3be466aeb9c29` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:51.009077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa819e-6828-428d-8ba7-094fb867da9a None admin] RBAC: Authorizing `identity:get_project(project_id=8d9e5a32df2546e385f3be466aeb9c29)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:51.010497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa819e-6828-428d-8ba7-094fb867da9a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:51.017156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 520/1052] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:10:50 2022] GET /identity/v3/projects/8d9e5a32df2546e385f3be466aeb9c29 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:51.018408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b976a1-9a35-4936-9121-70f9e6fe3242 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:51.121798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b976a1-9a35-4936-9121-70f9e6fe3242 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:51.156824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56db2f2-31a1-409b-a8a9-057ad9bc5f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:51.157430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56db2f2-31a1-409b-a8a9-057ad9bc5f86 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:51.157708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56db2f2-31a1-409b-a8a9-057ad9bc5f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:51.157979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56db2f2-31a1-409b-a8a9-057ad9bc5f86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:51.158695 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56db2f2-31a1-409b-a8a9-057ad9bc5f86 None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=8d9e5a32df2546e385f3be466aeb9c29, user.id=a8840e1a6e0a4b60b556880bc03a03a8) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:51.158999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56db2f2-31a1-409b-a8a9-057ad9bc5f86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:51.160463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56db2f2-31a1-409b-a8a9-057ad9bc5f86 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:51.175301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 533/1053] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:51 2022] GET /identity/v3/role_assignments?user.id=a8840e1a6e0a4b60b556880bc03a03a8&scope.project.id=8d9e5a32df2546e385f3be466aeb9c29&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:51.619842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083ff4-94ee-48d5-bf72-ce2cd16158e7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:51.619842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083ff4-94ee-48d5-bf72-ce2cd16158e7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:51.619842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083ff4-94ee-48d5-bf72-ce2cd16158e7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:51.619842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 521/1054] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:51.629138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64b06a-112b-44a3-8784-bf574fb76cb2 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:51.629552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64b06a-112b-44a3-8784-bf574fb76cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:51.629714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64b06a-112b-44a3-8784-bf574fb76cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:51.648853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c7237-2a08-40b7-8168-d234d87abbca None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:51.649256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c7237-2a08-40b7-8168-d234d87abbca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:51.649605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c7237-2a08-40b7-8168-d234d87abbca None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:51.651201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 522/1055] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:51.655105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-1c64b06a-112b-44a3-8784-bf574fb76cb2 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:51.656234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1c64b06a-112b-44a3-8784-bf574fb76cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:51.656820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c7d1-026b-4bcb-b7e7-f2a45e866a1a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:51.657303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c7d1-026b-4bcb-b7e7-f2a45e866a1a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:51.657771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c7d1-026b-4bcb-b7e7-f2a45e866a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:51.676218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cc51c7d1-026b-4bcb-b7e7-f2a45e866a1a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:51.677773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cc51c7d1-026b-4bcb-b7e7-f2a45e866a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:51.689945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:51.737094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 534/1056] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:51.767606 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 523/1057] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:52.011315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64b06a-112b-44a3-8784-bf574fb76cb2 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:52.022362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c7d1-026b-4bcb-b7e7-f2a45e866a1a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:52.063550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:52.116085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64b06a-112b-44a3-8784-bf574fb76cb2 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:52.138316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c7d1-026b-4bcb-b7e7-f2a45e866a1a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:52.152105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda826a-3602-4142-87cd-1689af0797bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:52.152747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda826a-3602-4142-87cd-1689af0797bf None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:52.153030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda826a-3602-4142-87cd-1689af0797bf None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:52.153303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda826a-3602-4142-87cd-1689af0797bf None admin] PATH_INFO: `/v3/services/image` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:52.153894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda826a-3602-4142-87cd-1689af0797bf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:52.155526 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda826a-3602-4142-87cd-1689af0797bf None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-2eda826a-3602-4142-87cd-1689af0797bf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:52.164872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:52.166104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:52.166975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 535/1058] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Sep 3 01:10:52 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:52.171977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda826a-3602-4142-87cd-1689af0797bf None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:52.184108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e7ec2-c48a-44cb-b655-db45a6aec1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:52.184936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e7ec2-c48a-44cb-b655-db45a6aec1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:52.185421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e7ec2-c48a-44cb-b655-db45a6aec1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:52.185914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e7ec2-c48a-44cb-b655-db45a6aec1c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:52.200175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e7ec2-c48a-44cb-b655-db45a6aec1c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-988e7ec2-c48a-44cb-b655-db45a6aec1c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:52.205704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:52.206863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:52.207896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:52.208664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:52.210147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 524/1059] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Sep 3 01:10:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:52.218116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e7ec2-c48a-44cb-b655-db45a6aec1c6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:52.290225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda826a-3602-4142-87cd-1689af0797bf None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:52.315053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:52.322931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e7ec2-c48a-44cb-b655-db45a6aec1c6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:52.327270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa31a4-eb18-4dc4-8e05-18abe2c681f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:52.327907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa31a4-eb18-4dc4-8e05-18abe2c681f8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:52.328186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa31a4-eb18-4dc4-8e05-18abe2c681f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:52.328460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa31a4-eb18-4dc4-8e05-18abe2c681f8 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:52.329086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa31a4-eb18-4dc4-8e05-18abe2c681f8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:52.329386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa31a4-eb18-4dc4-8e05-18abe2c681f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:52.331097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa31a4-eb18-4dc4-8e05-18abe2c681f8 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:52.340228 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 536/1060] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:52.341359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa31a4-eb18-4dc4-8e05-18abe2c681f8 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:52.362773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74c73b-0fd7-4f8b-836b-549fc0177861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:52.363411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74c73b-0fd7-4f8b-836b-549fc0177861 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:52.363692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74c73b-0fd7-4f8b-836b-549fc0177861 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:52.363964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74c73b-0fd7-4f8b-836b-549fc0177861 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:52.364625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74c73b-0fd7-4f8b-836b-549fc0177861 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:52.364919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74c73b-0fd7-4f8b-836b-549fc0177861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:52.366274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74c73b-0fd7-4f8b-836b-549fc0177861 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:52.374537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 525/1061] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Sep 3 01:10:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:52.380144 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74c73b-0fd7-4f8b-836b-549fc0177861 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:52.447519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:52.460425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa31a4-eb18-4dc4-8e05-18abe2c681f8 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:52.486035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74c73b-0fd7-4f8b-836b-549fc0177861 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:52.497580 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcef3b-2ee5-46ce-9ad1-c0ba31c44ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:52.498226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcef3b-2ee5-46ce-9ad1-c0ba31c44ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:52.498503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcef3b-2ee5-46ce-9ad1-c0ba31c44ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:52.498835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcef3b-2ee5-46ce-9ad1-c0ba31c44ab4 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:52.499500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcef3b-2ee5-46ce-9ad1-c0ba31c44ab4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:52.499800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcef3b-2ee5-46ce-9ad1-c0ba31c44ab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:52.501233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcef3b-2ee5-46ce-9ad1-c0ba31c44ab4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:52.510909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 537/1062] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:52.511887 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcef3b-2ee5-46ce-9ad1-c0ba31c44ab4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:52.526482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5acb0-74d0-4e63-bbcf-c4c760a59f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:52.527119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5acb0-74d0-4e63-bbcf-c4c760a59f43 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:52.527436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5acb0-74d0-4e63-bbcf-c4c760a59f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:52.527688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5acb0-74d0-4e63-bbcf-c4c760a59f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:52.539048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5acb0-74d0-4e63-bbcf-c4c760a59f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:52.540583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5acb0-74d0-4e63-bbcf-c4c760a59f43 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-39a5acb0-74d0-4e63-bbcf-c4c760a59f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:52.555469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:52.556437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:52.557572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:52.557572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:52.557572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:52.557572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 526/1063] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:52.562579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5acb0-74d0-4e63-bbcf-c4c760a59f43 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:52.575726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:52.619775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcef3b-2ee5-46ce-9ad1-c0ba31c44ab4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:52.654684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275852f-8a99-4b1f-99fb-8281117c6ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:52.655402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275852f-8a99-4b1f-99fb-8281117c6ade None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:52.655590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275852f-8a99-4b1f-99fb-8281117c6ade None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:52.655861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275852f-8a99-4b1f-99fb-8281117c6ade None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:52.656525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275852f-8a99-4b1f-99fb-8281117c6ade None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:52.657932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275852f-8a99-4b1f-99fb-8281117c6ade None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:52.671431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5acb0-74d0-4e63-bbcf-c4c760a59f43 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:52.679804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 538/1064] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:10:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:10:52.723143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428ee5d-cccb-4545-86da-aabf38fcb1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:52.723803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ee5d-cccb-4545-86da-aabf38fcb1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:52.724078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ee5d-cccb-4545-86da-aabf38fcb1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:52.724347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ee5d-cccb-4545-86da-aabf38fcb1d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:52.725011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428ee5d-cccb-4545-86da-aabf38fcb1d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:52.725307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428ee5d-cccb-4545-86da-aabf38fcb1d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:52.726759 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428ee5d-cccb-4545-86da-aabf38fcb1d2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:52.740923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 527/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:52.746589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275852f-8a99-4b1f-99fb-8281117c6ade None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:52.764626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:52.858798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275852f-8a99-4b1f-99fb-8281117c6ade None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:52.892801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1ca71-7244-4983-b5aa-7349b938bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:52.893440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1ca71-7244-4983-b5aa-7349b938bf3d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:52.893724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1ca71-7244-4983-b5aa-7349b938bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:52.893994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1ca71-7244-4983-b5aa-7349b938bf3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:52.901618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1ca71-7244-4983-b5aa-7349b938bf3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:52.903072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1ca71-7244-4983-b5aa-7349b938bf3d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-1db1ca71-7244-4983-b5aa-7349b938bf3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:52.914555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:52.915794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:52.917237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 539/1066] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Sep 3 01:10:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:52.921913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428ee5d-cccb-4545-86da-aabf38fcb1d2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:52.989536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:53.024839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428ee5d-cccb-4545-86da-aabf38fcb1d2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:53.058965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5c164-d09c-4e22-98c9-ec5c991752db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:53.059603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c164-d09c-4e22-98c9-ec5c991752db None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.059879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c164-d09c-4e22-98c9-ec5c991752db None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.060143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c164-d09c-4e22-98c9-ec5c991752db None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.060933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5c164-d09c-4e22-98c9-ec5c991752db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:53.061228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5c164-d09c-4e22-98c9-ec5c991752db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:53.062714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5c164-d09c-4e22-98c9-ec5c991752db None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:53.069963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113c734-1be9-4374-86c5-46fe405eed0f None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.070249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113c734-1be9-4374-86c5-46fe405eed0f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.070527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113c734-1be9-4374-86c5-46fe405eed0f None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.071963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 540/1067] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:10:53.076883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97929f9-ec08-48df-abe8-2ed3f4b6a8a0 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.077158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97929f9-ec08-48df-abe8-2ed3f4b6a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.077427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97929f9-ec08-48df-abe8-2ed3f4b6a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.084046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 528/1068] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Sep 3 01:10:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:53.089405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5c164-d09c-4e22-98c9-ec5c991752db None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:53.099711 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b97929f9-ec08-48df-abe8-2ed3f4b6a8a0 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:53.100909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b97929f9-ec08-48df-abe8-2ed3f4b6a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:53.175572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 541/1069] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:53.201950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5c164-d09c-4e22-98c9-ec5c991752db None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:53.226597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:53.239703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb531a4-8466-42cd-8f09-c6c1de6894a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:53.240560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb531a4-8466-42cd-8f09-c6c1de6894a6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.240985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb531a4-8466-42cd-8f09-c6c1de6894a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.241416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb531a4-8466-42cd-8f09-c6c1de6894a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.252613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb531a4-8466-42cd-8f09-c6c1de6894a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:53.254203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb531a4-8466-42cd-8f09-c6c1de6894a6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bcb531a4-8466-42cd-8f09-c6c1de6894a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:53.269485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:53.270649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:53.271806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:53.271806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:53.271806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:53.273583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 529/1070] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:53.279653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97929f9-ec08-48df-abe8-2ed3f4b6a8a0 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:53.283689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:53.386321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97929f9-ec08-48df-abe8-2ed3f4b6a8a0 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:53.421591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b51691-5f13-43cd-a053-9f76967d9ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:53.422471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51691-5f13-43cd-a053-9f76967d9ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.422936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51691-5f13-43cd-a053-9f76967d9ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.423412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51691-5f13-43cd-a053-9f76967d9ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.424225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b51691-5f13-43cd-a053-9f76967d9ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:53.424720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b51691-5f13-43cd-a053-9f76967d9ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:53.426328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b51691-5f13-43cd-a053-9f76967d9ce2 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:53.438299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 542/1071] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:53.444043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb531a4-8466-42cd-8f09-c6c1de6894a6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:53.445663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b51691-5f13-43cd-a053-9f76967d9ce2 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:53.513080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:53.546707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb531a4-8466-42cd-8f09-c6c1de6894a6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:53.556225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b51691-5f13-43cd-a053-9f76967d9ce2 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:53.580519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0561d4-3f1f-46d2-ad50-9315fa780456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:53.581153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0561d4-3f1f-46d2-ad50-9315fa780456 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.581427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0561d4-3f1f-46d2-ad50-9315fa780456 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.581694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0561d4-3f1f-46d2-ad50-9315fa780456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.588220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0561d4-3f1f-46d2-ad50-9315fa780456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:53.589649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0561d4-3f1f-46d2-ad50-9315fa780456 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:53.594340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3b855-4db5-4bbc-811b-aa998f82ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:53.595273 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b855-4db5-4bbc-811b-aa998f82ce28 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.595767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b855-4db5-4bbc-811b-aa998f82ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.596129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b855-4db5-4bbc-811b-aa998f82ce28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9b0561d4-3f1f-46d2-ad50-9315fa780456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:53.600851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:53.602018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:53.602936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:53.602936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:53.602936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:53.602936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:53.602936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:53.602936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:53.602936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:53.602936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:53.602936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 530/1072] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:53.608101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0561d4-3f1f-46d2-ad50-9315fa780456 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:53.611287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3b855-4db5-4bbc-811b-aa998f82ce28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-a9b3b855-4db5-4bbc-811b-aa998f82ce28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:53.615995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:53.616908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:53.617748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 543/1073] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:53.623107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3b855-4db5-4bbc-811b-aa998f82ce28 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:53.647410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:53.725377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0561d4-3f1f-46d2-ad50-9315fa780456 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:53.726530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3b855-4db5-4bbc-811b-aa998f82ce28 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:53.758844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:53.760750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca9c37-8a4b-42e8-b429-2344ea8f3e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:53.761364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca9c37-8a4b-42e8-b429-2344ea8f3e9c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.761644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca9c37-8a4b-42e8-b429-2344ea8f3e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.761922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca9c37-8a4b-42e8-b429-2344ea8f3e9c None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.762616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca9c37-8a4b-42e8-b429-2344ea8f3e9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:53.762920 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca9c37-8a4b-42e8-b429-2344ea8f3e9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:53.764557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca9c37-8a4b-42e8-b429-2344ea8f3e9c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:53.769804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede6ca-fa02-4532-9a4b-bd12ad5b2fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:53.770596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede6ca-fa02-4532-9a4b-bd12ad5b2fff None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.771482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede6ca-fa02-4532-9a4b-bd12ad5b2fff None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.771900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede6ca-fa02-4532-9a4b-bd12ad5b2fff None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.772697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fede6ca-fa02-4532-9a4b-bd12ad5b2fff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:53.773537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fede6ca-fa02-4532-9a4b-bd12ad5b2fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:53.775348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fede6ca-fa02-4532-9a4b-bd12ad5b2fff None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:53.775983 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 531/1074] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:53.782018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca9c37-8a4b-42e8-b429-2344ea8f3e9c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:53.786590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 544/1075] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:53.792081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede6ca-fa02-4532-9a4b-bd12ad5b2fff None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:53.884588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:53.892557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca9c37-8a4b-42e8-b429-2344ea8f3e9c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:53.915375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede6ca-fa02-4532-9a4b-bd12ad5b2fff None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:53.929525 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01092c07-01fb-40f8-ba30-42bb42d96b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:53.930375 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01092c07-01fb-40f8-ba30-42bb42d96b0b None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.930946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01092c07-01fb-40f8-ba30-42bb42d96b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.931225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01092c07-01fb-40f8-ba30-42bb42d96b0b None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/9c4076fd5abc4b508a0215ce22af85d6/roles/719d26d82310436eb8ca76e8097c43ec` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.933484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01092c07-01fb-40f8-ba30-42bb42d96b0b None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=9c4076fd5abc4b508a0215ce22af85d6, role_id=719d26d82310436eb8ca76e8097c43ec)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:53.935045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01092c07-01fb-40f8-ba30-42bb42d96b0b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:53.948473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97542ee-2f0c-454d-9ce5-c266449ba168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:53.949119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97542ee-2f0c-454d-9ce5-c266449ba168 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:53.949394 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97542ee-2f0c-454d-9ce5-c266449ba168 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:53.949663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97542ee-2f0c-454d-9ce5-c266449ba168 None admin] PATH_INFO: `/v3/users/a8840e1a6e0a4b60b556880bc03a03a8` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:53.955298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97542ee-2f0c-454d-9ce5-c266449ba168 None admin] RBAC: Authorizing `identity:get_user(user_id=a8840e1a6e0a4b60b556880bc03a03a8)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:53.955472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 532/1076] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:10:53 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/9c4076fd5abc4b508a0215ce22af85d6/roles/719d26d82310436eb8ca76e8097c43ec => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:10:53.955596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97542ee-2f0c-454d-9ce5-c266449ba168 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:53.955596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 545/1077] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:10:53 2022] GET /identity/v3/users/a8840e1a6e0a4b60b556880bc03a03a8 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:53.960312 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01092c07-01fb-40f8-ba30-42bb42d96b0b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:54.080954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01092c07-01fb-40f8-ba30-42bb42d96b0b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:54.121050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7185a-ff9b-455d-9639-8cbcf59af3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:54.121695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7185a-ff9b-455d-9639-8cbcf59af3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:54.121973 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7185a-ff9b-455d-9639-8cbcf59af3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:54.122242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7185a-ff9b-455d-9639-8cbcf59af3f2 None admin] PATH_INFO: `/v3/projects/8d9e5a32df2546e385f3be466aeb9c29` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:54.123734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7185a-ff9b-455d-9639-8cbcf59af3f2 None admin] RBAC: Authorizing `identity:get_project(project_id=8d9e5a32df2546e385f3be466aeb9c29)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:54.125173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7185a-ff9b-455d-9639-8cbcf59af3f2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:54.127125 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 533/1078] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:10:53 2022] GET /identity/v3/projects/8d9e5a32df2546e385f3be466aeb9c29 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:54.133214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97542ee-2f0c-454d-9ce5-c266449ba168 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:54.205088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:54.253866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97542ee-2f0c-454d-9ce5-c266449ba168 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:54.287878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f9c2e-210d-4f83-9191-db703e05cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:54.288538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f9c2e-210d-4f83-9191-db703e05cdb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:54.288813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f9c2e-210d-4f83-9191-db703e05cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:54.289059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f9c2e-210d-4f83-9191-db703e05cdb5 None admin] PATH_INFO: `/v3/projects/8d9e5a32df2546e385f3be466aeb9c29/users/a8840e1a6e0a4b60b556880bc03a03a8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:54.290963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f9c2e-210d-4f83-9191-db703e05cdb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d9e5a32df2546e385f3be466aeb9c29, user_id=a8840e1a6e0a4b60b556880bc03a03a8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:54.292425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f9c2e-210d-4f83-9191-db703e05cdb5 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:54.308210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 546/1079] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:10:54 2022] PUT /identity/v3/projects/8d9e5a32df2546e385f3be466aeb9c29/users/a8840e1a6e0a4b60b556880bc03a03a8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:10:54.669484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11718461-625c-4fbf-8306-6abf9ce5e435 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:54.669905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11718461-625c-4fbf-8306-6abf9ce5e435 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:54.670088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11718461-625c-4fbf-8306-6abf9ce5e435 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:54.671612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 534/1080] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:54.676680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8f154-6fa0-4609-8cf8-b25c279bfdf9 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:54.676975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8f154-6fa0-4609-8cf8-b25c279bfdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:54.677231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8f154-6fa0-4609-8cf8-b25c279bfdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:54.696090 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-1bc8f154-6fa0-4609-8cf8-b25c279bfdf9 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:54.697260 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1bc8f154-6fa0-4609-8cf8-b25c279bfdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:54.769161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 547/1081] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:55.040504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11718461-625c-4fbf-8306-6abf9ce5e435 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:55.068515 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:55.148244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11718461-625c-4fbf-8306-6abf9ce5e435 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:55.186080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074d2c6-5333-4b9f-8991-07788e2ebe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:55.186701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074d2c6-5333-4b9f-8991-07788e2ebe9d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:55.186965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074d2c6-5333-4b9f-8991-07788e2ebe9d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:55.187233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074d2c6-5333-4b9f-8991-07788e2ebe9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:55.257274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074d2c6-5333-4b9f-8991-07788e2ebe9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:55.258709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074d2c6-5333-4b9f-8991-07788e2ebe9d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:55.283433 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:55.359285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 535/1082] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:10:55.365146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8f154-6fa0-4609-8cf8-b25c279bfdf9 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:55.415120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:55.472909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8f154-6fa0-4609-8cf8-b25c279bfdf9 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:55.506968 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd42749-3873-4fbd-af94-0183d39ebf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:55.507647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd42749-3873-4fbd-af94-0183d39ebf9c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:55.507929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd42749-3873-4fbd-af94-0183d39ebf9c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:55.508200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd42749-3873-4fbd-af94-0183d39ebf9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:55.518514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd42749-3873-4fbd-af94-0183d39ebf9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:55.520015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd42749-3873-4fbd-af94-0183d39ebf9c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-8fd42749-3873-4fbd-af94-0183d39ebf9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:55.534717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:55.540798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:55.541732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:55.541732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:55.541732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:55.541732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 548/1083] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:55.542003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074d2c6-5333-4b9f-8991-07788e2ebe9d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:55.642799 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074d2c6-5333-4b9f-8991-07788e2ebe9d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:55.665912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:55.678642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7f067-0a25-4032-8758-bc4b69a7dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:55.679344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7f067-0a25-4032-8758-bc4b69a7dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:55.679552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7f067-0a25-4032-8758-bc4b69a7dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:55.679830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7f067-0a25-4032-8758-bc4b69a7dbb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:55.680478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7f067-0a25-4032-8758-bc4b69a7dbb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:55.680777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7f067-0a25-4032-8758-bc4b69a7dbb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:55.682146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7f067-0a25-4032-8758-bc4b69a7dbb9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:55.693960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 536/1084] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:55.849734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab68059-fd74-40a3-b41f-1b57a0822904 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:55.850261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab68059-fd74-40a3-b41f-1b57a0822904 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:55.850261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab68059-fd74-40a3-b41f-1b57a0822904 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:55.851915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 549/1085] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:55.857808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a97d12-bfe8-4b3b-8e79-c780228ad158 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:55.858120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a97d12-bfe8-4b3b-8e79-c780228ad158 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:55.858404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a97d12-bfe8-4b3b-8e79-c780228ad158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:55.877674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c7a97d12-bfe8-4b3b-8e79-c780228ad158 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:55.878884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c7a97d12-bfe8-4b3b-8e79-c780228ad158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:55.948210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 537/1086] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:56.202970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca5b6-98c0-428c-a48f-4e8486bd7166 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:56.203155 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca5b6-98c0-428c-a48f-4e8486bd7166 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:56.203483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca5b6-98c0-428c-a48f-4e8486bd7166 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:56.204923 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 550/1087] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:56.210357 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618774-57db-4ff7-84fb-237747d4d131 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:56.210801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618774-57db-4ff7-84fb-237747d4d131 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:56.210888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618774-57db-4ff7-84fb-237747d4d131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:56.220114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca5b6-98c0-428c-a48f-4e8486bd7166 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:56.230785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-23618774-57db-4ff7-84fb-237747d4d131 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:56.232073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-23618774-57db-4ff7-84fb-237747d4d131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:56.299817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 538/1088] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:56.318824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:56.325959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca5b6-98c0-428c-a48f-4e8486bd7166 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:56.359745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cad184-6e06-494f-832b-a2e1b0233853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:56.360367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cad184-6e06-494f-832b-a2e1b0233853 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:56.360650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cad184-6e06-494f-832b-a2e1b0233853 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:56.360916 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cad184-6e06-494f-832b-a2e1b0233853 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:56.371077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cad184-6e06-494f-832b-a2e1b0233853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-c6cad184-6e06-494f-832b-a2e1b0233853 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:56.376015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:56.376979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:56.377818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 551/1089] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Sep 3 01:10:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:56.383285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23618774-57db-4ff7-84fb-237747d4d131 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:56.428752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:56.484459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23618774-57db-4ff7-84fb-237747d4d131 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:56.518594 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51f585-03a2-457c-a847-4c730ec22144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:56.519198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f585-03a2-457c-a847-4c730ec22144 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:56.519500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f585-03a2-457c-a847-4c730ec22144 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:56.519774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f585-03a2-457c-a847-4c730ec22144 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:56.520441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51f585-03a2-457c-a847-4c730ec22144 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:56.520744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51f585-03a2-457c-a847-4c730ec22144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:56.522109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51f585-03a2-457c-a847-4c730ec22144 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:56.530290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 539/1090] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Sep 3 01:10:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:56.536002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cad184-6e06-494f-832b-a2e1b0233853 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:56.562978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51f585-03a2-457c-a847-4c730ec22144 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:56.638262 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cad184-6e06-494f-832b-a2e1b0233853 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:56.663605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51f585-03a2-457c-a847-4c730ec22144 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:56.670465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:56.672474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b345af-3f72-4d53-98c4-aad2548eb43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:56.673178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b345af-3f72-4d53-98c4-aad2548eb43f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:56.673488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b345af-3f72-4d53-98c4-aad2548eb43f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:56.673762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b345af-3f72-4d53-98c4-aad2548eb43f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:56.683870 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b345af-3f72-4d53-98c4-aad2548eb43f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:56.685497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b345af-3f72-4d53-98c4-aad2548eb43f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:56.698248 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19736fc-71fe-4b71-8dbf-4c4d1b0ff1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:56.698883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19736fc-71fe-4b71-8dbf-4c4d1b0ff1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:56.699159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19736fc-71fe-4b71-8dbf-4c4d1b0ff1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:56.699460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19736fc-71fe-4b71-8dbf-4c4d1b0ff1e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-e1b345af-3f72-4d53-98c4-aad2548eb43f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:56.700189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:56.701618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:56.702523 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:56.702523 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:56.702523 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:56.702523 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 552/1091] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:56.707588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b345af-3f72-4d53-98c4-aad2548eb43f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:56.711619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19736fc-71fe-4b71-8dbf-4c4d1b0ff1e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b19736fc-71fe-4b71-8dbf-4c4d1b0ff1e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:10:56.716425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:56.717593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:10:56.718781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 540/1092] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:56.721792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:56.723452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19736fc-71fe-4b71-8dbf-4c4d1b0ff1e8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:56.812758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b345af-3f72-4d53-98c4-aad2548eb43f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:56.818517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19736fc-71fe-4b71-8dbf-4c4d1b0ff1e8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:56.845852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42478577-21e5-4d0e-90fc-9931e08e9b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:56.846456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42478577-21e5-4d0e-90fc-9931e08e9b5a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:56.846731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42478577-21e5-4d0e-90fc-9931e08e9b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:56.847004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42478577-21e5-4d0e-90fc-9931e08e9b5a None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:56.847669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42478577-21e5-4d0e-90fc-9931e08e9b5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:56.847967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42478577-21e5-4d0e-90fc-9931e08e9b5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:56.849340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42478577-21e5-4d0e-90fc-9931e08e9b5a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:56.850707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794981a0-616b-44f9-b9a7-91bd5056fed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:56.851342 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794981a0-616b-44f9-b9a7-91bd5056fed3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:56.851626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794981a0-616b-44f9-b9a7-91bd5056fed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:56.851897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794981a0-616b-44f9-b9a7-91bd5056fed3 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:56.852557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794981a0-616b-44f9-b9a7-91bd5056fed3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:56.852857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794981a0-616b-44f9-b9a7-91bd5056fed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:56.854576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794981a0-616b-44f9-b9a7-91bd5056fed3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:56.861916 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 553/1093] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:56.866010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 541/1094] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:56.868758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42478577-21e5-4d0e-90fc-9931e08e9b5a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:56.868903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794981a0-616b-44f9-b9a7-91bd5056fed3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:56.898169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:56.935517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:56.967542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42478577-21e5-4d0e-90fc-9931e08e9b5a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:56.968050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794981a0-616b-44f9-b9a7-91bd5056fed3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:57.001477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649426e-b765-41e8-8d85-290de7b5c7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:57.002102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649426e-b765-41e8-8d85-290de7b5c7ba None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:57.002376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649426e-b765-41e8-8d85-290de7b5c7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:57.002643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649426e-b765-41e8-8d85-290de7b5c7ba None admin] PATH_INFO: `/v3/users/a8840e1a6e0a4b60b556880bc03a03a8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:57.002912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d5925-549f-46ba-99f1-6bdafde9485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:57.003572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d5925-549f-46ba-99f1-6bdafde9485f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:57.003775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649426e-b765-41e8-8d85-290de7b5c7ba None admin] RBAC: Authorizing `identity:get_user(user_id=a8840e1a6e0a4b60b556880bc03a03a8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:57.003870 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d5925-549f-46ba-99f1-6bdafde9485f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:57.004110 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d5925-549f-46ba-99f1-6bdafde9485f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:57.005243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649426e-b765-41e8-8d85-290de7b5c7ba None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:57.006805 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 542/1095] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:10:56 2022] GET /identity/v3/users/a8840e1a6e0a4b60b556880bc03a03a8 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:57.011240 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d5925-549f-46ba-99f1-6bdafde9485f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:57.012703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d5925-549f-46ba-99f1-6bdafde9485f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:57.012838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649426e-b765-41e8-8d85-290de7b5c7ba None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-269d5925-549f-46ba-99f1-6bdafde9485f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:10:57.025279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:57.026435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:57.027428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 554/1096] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Sep 3 01:10:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:57.032336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d5925-549f-46ba-99f1-6bdafde9485f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:57.106700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:57.113378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649426e-b765-41e8-8d85-290de7b5c7ba None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:57.130226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d5925-549f-46ba-99f1-6bdafde9485f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:57.146514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e41dc9-7c47-4f43-bbb9-6de5d708f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:57.147118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e41dc9-7c47-4f43-bbb9-6de5d708f8ef None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:57.147423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e41dc9-7c47-4f43-bbb9-6de5d708f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:57.147694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e41dc9-7c47-4f43-bbb9-6de5d708f8ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:57.155108 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:57.163417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147889a-4642-49f2-a541-750378a8876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:57.164016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147889a-4642-49f2-a541-750378a8876c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:57.164293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147889a-4642-49f2-a541-750378a8876c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:57.164534 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147889a-4642-49f2-a541-750378a8876c None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:57.165254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147889a-4642-49f2-a541-750378a8876c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:57.165554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147889a-4642-49f2-a541-750378a8876c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:57.167008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147889a-4642-49f2-a541-750378a8876c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:57.184137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 555/1097] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Sep 3 01:10:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:57.190020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147889a-4642-49f2-a541-750378a8876c None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:57.222317 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e41dc9-7c47-4f43-bbb9-6de5d708f8ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:57.223825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e41dc9-7c47-4f43-bbb9-6de5d708f8ef None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:57.287921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147889a-4642-49f2-a541-750378a8876c None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:57.315268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:57.321453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac24b8a-6752-4e69-8b35-a8c48c804d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:57.322089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 543/1098] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 03 01:10:57.327388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac24b8a-6752-4e69-8b35-a8c48c804d83 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:57.327388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac24b8a-6752-4e69-8b35-a8c48c804d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:57.327388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac24b8a-6752-4e69-8b35-a8c48c804d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:57.328398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e41dc9-7c47-4f43-bbb9-6de5d708f8ef None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:57.379194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:57.391805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac24b8a-6752-4e69-8b35-a8c48c804d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:57.393281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac24b8a-6752-4e69-8b35-a8c48c804d83 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:57.425163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e41dc9-7c47-4f43-bbb9-6de5d708f8ef None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:57.457497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee758-d4b5-4d07-9340-435694d87177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:57.458123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee758-d4b5-4d07-9340-435694d87177 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:57.458403 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee758-d4b5-4d07-9340-435694d87177 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:57.458669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee758-d4b5-4d07-9340-435694d87177 None admin] PATH_INFO: `/v3/projects/8d9e5a32df2546e385f3be466aeb9c29` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:57.459801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee758-d4b5-4d07-9340-435694d87177 None admin] RBAC: Authorizing `identity:get_project(project_id=8d9e5a32df2546e385f3be466aeb9c29)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:57.461213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee758-d4b5-4d07-9340-435694d87177 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:57.462850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 544/1099] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:10:57 2022] GET /identity/v3/projects/8d9e5a32df2546e385f3be466aeb9c29 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:57.469102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee758-d4b5-4d07-9340-435694d87177 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:57.489171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 556/1100] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:10:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 03 01:10:57.494758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac24b8a-6752-4e69-8b35-a8c48c804d83 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:57.530780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:57.569803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee758-d4b5-4d07-9340-435694d87177 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:57.576297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:57.591211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac24b8a-6752-4e69-8b35-a8c48c804d83 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:57.605011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14836ae8-b405-4d4a-8678-207317b52803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:57.605617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14836ae8-b405-4d4a-8678-207317b52803 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:57.605890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14836ae8-b405-4d4a-8678-207317b52803 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:57.606179 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14836ae8-b405-4d4a-8678-207317b52803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:57.606945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14836ae8-b405-4d4a-8678-207317b52803 None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=8d9e5a32df2546e385f3be466aeb9c29, user.id=a8840e1a6e0a4b60b556880bc03a03a8) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:57.607276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14836ae8-b405-4d4a-8678-207317b52803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:57.608704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14836ae8-b405-4d4a-8678-207317b52803 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:57.614527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 545/1101] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:57 2022] GET /identity/v3/role_assignments?user.id=a8840e1a6e0a4b60b556880bc03a03a8&scope.project.id=8d9e5a32df2546e385f3be466aeb9c29&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:10:57.627730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde76f5-4308-429c-9a76-d9761d5e0a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:57.628390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde76f5-4308-429c-9a76-d9761d5e0a9a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:57.628668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde76f5-4308-429c-9a76-d9761d5e0a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:57.628940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde76f5-4308-429c-9a76-d9761d5e0a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:57.641417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde76f5-4308-429c-9a76-d9761d5e0a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:57.642819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde76f5-4308-429c-9a76-d9761d5e0a9a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-8fde76f5-4308-429c-9a76-d9761d5e0a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:10:57.659865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:57.661030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:10:57.661921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:10:57.661921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:10:57.661921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:57.661921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 557/1102] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:10:57.667291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14836ae8-b405-4d4a-8678-207317b52803 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:57.775872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14836ae8-b405-4d4a-8678-207317b52803 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:57.801808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:57.810361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1156a6-157a-4e16-af0d-37fd35ba5159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:57.810988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1156a6-157a-4e16-af0d-37fd35ba5159 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:57.811316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1156a6-157a-4e16-af0d-37fd35ba5159 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:57.811597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1156a6-157a-4e16-af0d-37fd35ba5159 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:57.812277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1156a6-157a-4e16-af0d-37fd35ba5159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:57.812576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1156a6-157a-4e16-af0d-37fd35ba5159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:57.813934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1156a6-157a-4e16-af0d-37fd35ba5159 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:57.825739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 546/1103] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:57.831558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde76f5-4308-429c-9a76-d9761d5e0a9a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:57.931936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde76f5-4308-429c-9a76-d9761d5e0a9a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:57.968909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b10a0-56e4-4767-b6be-cd51a91cba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:57.969573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b10a0-56e4-4767-b6be-cd51a91cba7c None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:57.969852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b10a0-56e4-4767-b6be-cd51a91cba7c None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:57.970125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b10a0-56e4-4767-b6be-cd51a91cba7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:57.977044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b10a0-56e4-4767-b6be-cd51a91cba7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:57.978498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b10a0-56e4-4767-b6be-cd51a91cba7c None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:57.980573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-994b10a0-56e4-4767-b6be-cd51a91cba7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:10:57.991153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:10:57.992277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:10:57.993476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:10:57.993476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:10:57.993476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:10:57.993476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:10:57.993476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:10:57.993476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:10:57.993476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:10:57.993476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:10:57.995612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 558/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:10:57.998255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1156a6-157a-4e16-af0d-37fd35ba5159 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:58.100228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1156a6-157a-4e16-af0d-37fd35ba5159 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:58.137052 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff67a5f-963a-40c7-b283-e8601f8f4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:58.137661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff67a5f-963a-40c7-b283-e8601f8f4234 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:58.137941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff67a5f-963a-40c7-b283-e8601f8f4234 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:58.138277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff67a5f-963a-40c7-b283-e8601f8f4234 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:58.138992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff67a5f-963a-40c7-b283-e8601f8f4234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:58.139351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff67a5f-963a-40c7-b283-e8601f8f4234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:58.140782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff67a5f-963a-40c7-b283-e8601f8f4234 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:58.152739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 547/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:10:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:58.159049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b10a0-56e4-4767-b6be-cd51a91cba7c None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:58.259861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b10a0-56e4-4767-b6be-cd51a91cba7c None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:10:58.294086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8eeda-a101-4067-8f3d-9f6043dca067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:10:58.294735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8eeda-a101-4067-8f3d-9f6043dca067 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:58.295014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8eeda-a101-4067-8f3d-9f6043dca067 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:58.295293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8eeda-a101-4067-8f3d-9f6043dca067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:58.296033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8eeda-a101-4067-8f3d-9f6043dca067 None admin] RBAC: Adding query filter params (role.id=719d26d82310436eb8ca76e8097c43ec, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=9c4076fd5abc4b508a0215ce22af85d6) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:10:58.296338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8eeda-a101-4067-8f3d-9f6043dca067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:10:58.297783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8eeda-a101-4067-8f3d-9f6043dca067 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:10:58.303630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 559/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:10:58 2022] GET /identity/v3/role_assignments?user.id=9c4076fd5abc4b508a0215ce22af85d6&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=719d26d82310436eb8ca76e8097c43ec => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:10:59.528999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95f0f-9a3d-402c-853a-22d866f29f2f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:59.529801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95f0f-9a3d-402c-853a-22d866f29f2f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:59.530012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95f0f-9a3d-402c-853a-22d866f29f2f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:59.532108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 548/1107] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:10:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:10:59.538356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91c1bc-a91c-4106-a8b0-7affd204483d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:10:59.539033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91c1bc-a91c-4106-a8b0-7affd204483d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:10:59.539234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91c1bc-a91c-4106-a8b0-7affd204483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:10:59.562128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-fa91c1bc-a91c-4106-a8b0-7affd204483d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:10:59.563321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-fa91c1bc-a91c-4106-a8b0-7affd204483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:10:59.628697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:10:59.640380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 560/1108] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:10:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:10:59.909825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b95f0f-9a3d-402c-853a-22d866f29f2f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:10:59.964019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:00.017719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b95f0f-9a3d-402c-853a-22d866f29f2f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:00.052552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75528e96-2529-4b03-bf87-e11717697e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:00.053167 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528e96-2529-4b03-bf87-e11717697e65 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:00.053438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528e96-2529-4b03-bf87-e11717697e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:00.053705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528e96-2529-4b03-bf87-e11717697e65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:00.055052 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75528e96-2529-4b03-bf87-e11717697e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:00.056501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75528e96-2529-4b03-bf87-e11717697e65 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:00.058052 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 549/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:10:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:00.064710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91c1bc-a91c-4106-a8b0-7affd204483d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:00.174928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91c1bc-a91c-4106-a8b0-7affd204483d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:00.213279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad4737-da08-45d3-99c2-2d3cac2c0dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:00.213883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad4737-da08-45d3-99c2-2d3cac2c0dd4 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:00.214156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad4737-da08-45d3-99c2-2d3cac2c0dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:00.214421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad4737-da08-45d3-99c2-2d3cac2c0dd4 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:00.215053 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad4737-da08-45d3-99c2-2d3cac2c0dd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:00.216558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad4737-da08-45d3-99c2-2d3cac2c0dd4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:00.241925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 561/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:11:00 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:11:02.167550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdfdb7-b0d2-4a92-8970-600776487e4c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:02.168155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdfdb7-b0d2-4a92-8970-600776487e4c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:02.168155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdfdb7-b0d2-4a92-8970-600776487e4c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:02.169477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 550/1111] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:02.176101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b690a-13d0-4d6b-808b-d6a03edfeafa None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:02.176552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b690a-13d0-4d6b-808b-d6a03edfeafa None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:02.176641 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b690a-13d0-4d6b-808b-d6a03edfeafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:02.201553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-007b690a-13d0-4d6b-808b-d6a03edfeafa None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:02.202747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-007b690a-13d0-4d6b-808b-d6a03edfeafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:02.249017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:02.275013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 562/1112] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:02.539388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdfdb7-b0d2-4a92-8970-600776487e4c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:02.651508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdfdb7-b0d2-4a92-8970-600776487e4c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:02.667905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:02.686873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f116a6-e232-413a-833c-66412d14c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:02.687524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f116a6-e232-413a-833c-66412d14c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:02.687794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f116a6-e232-413a-833c-66412d14c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:02.688060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f116a6-e232-413a-833c-66412d14c2f2 None admin] PATH_INFO: `/v3/roles/4111136d5e114c4b9ca719aa39f4bc23` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:02.689545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f116a6-e232-413a-833c-66412d14c2f2 None admin] RBAC: Authorizing `identity:get_role(role_id=4111136d5e114c4b9ca719aa39f4bc23)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:02.690901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f116a6-e232-413a-833c-66412d14c2f2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:02.692250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 551/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:02 2022] GET /identity/v3/roles/4111136d5e114c4b9ca719aa39f4bc23 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:02.698936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b690a-13d0-4d6b-808b-d6a03edfeafa None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:02.813484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b690a-13d0-4d6b-808b-d6a03edfeafa None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:02.848489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e908d32-6717-493a-a86e-8538f36c8961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:02.849107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e908d32-6717-493a-a86e-8538f36c8961 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:02.849381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e908d32-6717-493a-a86e-8538f36c8961 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:02.849649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e908d32-6717-493a-a86e-8538f36c8961 None admin] PATH_INFO: `/v3/users/d557ba6e08614d9b8513527f2acca7c9` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:02.863475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e908d32-6717-493a-a86e-8538f36c8961 None admin] RBAC: Authorizing `identity:get_user(user_id=d557ba6e08614d9b8513527f2acca7c9)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:02.864919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e908d32-6717-493a-a86e-8538f36c8961 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:02.866493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 563/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:02 2022] GET /identity/v3/users/d557ba6e08614d9b8513527f2acca7c9 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:02.874698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f116a6-e232-413a-833c-66412d14c2f2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:02.981455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f116a6-e232-413a-833c-66412d14c2f2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:03.016401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaea76-9115-4d7a-ae56-e6c35329915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:03.016997 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaea76-9115-4d7a-ae56-e6c35329915f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:03.017262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaea76-9115-4d7a-ae56-e6c35329915f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:03.017526 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaea76-9115-4d7a-ae56-e6c35329915f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:03.080419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:03.096377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaea76-9115-4d7a-ae56-e6c35329915f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:03.097817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaea76-9115-4d7a-ae56-e6c35329915f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:03.203499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 552/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:11:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:11:03.209599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e908d32-6717-493a-a86e-8538f36c8961 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:03.247264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:03.312804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e908d32-6717-493a-a86e-8538f36c8961 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:03.348353 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e02ac-e233-4921-8598-4d54e52f70ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:03.348905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e02ac-e233-4921-8598-4d54e52f70ed None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:03.349194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e02ac-e233-4921-8598-4d54e52f70ed None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:03.349457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e02ac-e233-4921-8598-4d54e52f70ed None admin] PATH_INFO: `/v3/projects/8d9e5a32df2546e385f3be466aeb9c29` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:03.350675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e02ac-e233-4921-8598-4d54e52f70ed None admin] RBAC: Authorizing `identity:get_project(project_id=8d9e5a32df2546e385f3be466aeb9c29)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:03.352137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e02ac-e233-4921-8598-4d54e52f70ed None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:03.354107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 564/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:11:03 2022] GET /identity/v3/projects/8d9e5a32df2546e385f3be466aeb9c29 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:03.364060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaea76-9115-4d7a-ae56-e6c35329915f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:03.449999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:03.467021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaea76-9115-4d7a-ae56-e6c35329915f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:03.504392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd4e7c-efe9-427f-850f-4522f73567f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:03.504988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4e7c-efe9-427f-850f-4522f73567f8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:03.505256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4e7c-efe9-427f-850f-4522f73567f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:03.505516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4e7c-efe9-427f-850f-4522f73567f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:03.506225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd4e7c-efe9-427f-850f-4522f73567f8 None admin] RBAC: Adding query filter params (role.id=4111136d5e114c4b9ca719aa39f4bc23, scope.project.id=8d9e5a32df2546e385f3be466aeb9c29, user.id=d557ba6e08614d9b8513527f2acca7c9) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:03.506519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd4e7c-efe9-427f-850f-4522f73567f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:03.507961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd4e7c-efe9-427f-850f-4522f73567f8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:03.513912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 553/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:11:03 2022] GET /identity/v3/role_assignments?user.id=d557ba6e08614d9b8513527f2acca7c9&scope.project.id=8d9e5a32df2546e385f3be466aeb9c29&role.id=4111136d5e114c4b9ca719aa39f4bc23 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:05.367945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834dcf0-bdb3-462b-bacf-129c9bdb5303 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:05.368528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834dcf0-bdb3-462b-bacf-129c9bdb5303 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:05.368528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834dcf0-bdb3-462b-bacf-129c9bdb5303 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:05.369831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 565/1118] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:05.376508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa64ed-d66e-4bd4-84d5-09e2760b9bd4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:05.377288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa64ed-d66e-4bd4-84d5-09e2760b9bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:05.377410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa64ed-d66e-4bd4-84d5-09e2760b9bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:05.400499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fcfa64ed-d66e-4bd4-84d5-09e2760b9bd4 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:05.401680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fcfa64ed-d66e-4bd4-84d5-09e2760b9bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:05.469942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 554/1119] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:05.748002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834dcf0-bdb3-462b-bacf-129c9bdb5303 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:05.871891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834dcf0-bdb3-462b-bacf-129c9bdb5303 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:05.874253 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:05.909386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a14c98-8b89-4cef-a9f3-af51d9cea021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:05.910007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14c98-8b89-4cef-a9f3-af51d9cea021 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:05.910281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14c98-8b89-4cef-a9f3-af51d9cea021 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:05.910556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14c98-8b89-4cef-a9f3-af51d9cea021 None admin] PATH_INFO: `/v3/roles/4111136d5e114c4b9ca719aa39f4bc23` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:05.912095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a14c98-8b89-4cef-a9f3-af51d9cea021 None admin] RBAC: Authorizing `identity:get_role(role_id=4111136d5e114c4b9ca719aa39f4bc23)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:05.913473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a14c98-8b89-4cef-a9f3-af51d9cea021 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:05.914803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 566/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:05 2022] GET /identity/v3/roles/4111136d5e114c4b9ca719aa39f4bc23 => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:05.921379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa64ed-d66e-4bd4-84d5-09e2760b9bd4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:06.004440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:06.027860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa64ed-d66e-4bd4-84d5-09e2760b9bd4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:06.062928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1784493-b5ea-4e5e-962c-8f880350d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:06.063579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1784493-b5ea-4e5e-962c-8f880350d1cc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:06.063859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1784493-b5ea-4e5e-962c-8f880350d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:06.064130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1784493-b5ea-4e5e-962c-8f880350d1cc None admin] PATH_INFO: `/v3/users/d557ba6e08614d9b8513527f2acca7c9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:06.065356 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1784493-b5ea-4e5e-962c-8f880350d1cc None admin] RBAC: Authorizing `identity:get_user(user_id=d557ba6e08614d9b8513527f2acca7c9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:06.066774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1784493-b5ea-4e5e-962c-8f880350d1cc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:06.068391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 555/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:05 2022] GET /identity/v3/users/d557ba6e08614d9b8513527f2acca7c9 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:06.075081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a14c98-8b89-4cef-a9f3-af51d9cea021 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:06.179534 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a14c98-8b89-4cef-a9f3-af51d9cea021 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:06.215586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f869673-47f6-4e66-ae98-49ebbc33f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:06.216280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f869673-47f6-4e66-ae98-49ebbc33f939 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:06.216559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f869673-47f6-4e66-ae98-49ebbc33f939 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:06.216832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f869673-47f6-4e66-ae98-49ebbc33f939 None admin] PATH_INFO: `/v3/projects/8d9e5a32df2546e385f3be466aeb9c29` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:06.217958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f869673-47f6-4e66-ae98-49ebbc33f939 None admin] RBAC: Authorizing `identity:get_project(project_id=8d9e5a32df2546e385f3be466aeb9c29)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:06.219422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f869673-47f6-4e66-ae98-49ebbc33f939 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:06.221064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 567/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:11:06 2022] GET /identity/v3/projects/8d9e5a32df2546e385f3be466aeb9c29 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:06.227408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1784493-b5ea-4e5e-962c-8f880350d1cc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:06.333778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1784493-b5ea-4e5e-962c-8f880350d1cc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:06.373461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9191945-6d92-4f5e-a433-2e52d7890224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:06.374105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191945-6d92-4f5e-a433-2e52d7890224 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:06.374380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191945-6d92-4f5e-a433-2e52d7890224 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:06.374648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191945-6d92-4f5e-a433-2e52d7890224 None admin] PATH_INFO: `/v3/projects/8d9e5a32df2546e385f3be466aeb9c29/users/d557ba6e08614d9b8513527f2acca7c9/roles/4111136d5e114c4b9ca719aa39f4bc23` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:06.377178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9191945-6d92-4f5e-a433-2e52d7890224 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d9e5a32df2546e385f3be466aeb9c29, user_id=d557ba6e08614d9b8513527f2acca7c9, role_id=4111136d5e114c4b9ca719aa39f4bc23)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:06.378594 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9191945-6d92-4f5e-a433-2e52d7890224 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:06.393822 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 556/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:11:06 2022] PUT /identity/v3/projects/8d9e5a32df2546e385f3be466aeb9c29/users/d557ba6e08614d9b8513527f2acca7c9/roles/4111136d5e114c4b9ca719aa39f4bc23 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:11:08.253586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5aa0-8170-4177-bd14-349f2c2aeefc None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:08.254457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5aa0-8170-4177-bd14-349f2c2aeefc None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:08.254457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5aa0-8170-4177-bd14-349f2c2aeefc None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:08.256624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 568/1124] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:08.261934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d2225-7ad5-4dcb-8d03-10aa1a82ab8e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:08.262385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d2225-7ad5-4dcb-8d03-10aa1a82ab8e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:08.262613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d2225-7ad5-4dcb-8d03-10aa1a82ab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:08.276523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:08.284573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ca0d2225-7ad5-4dcb-8d03-10aa1a82ab8e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:08.287575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ca0d2225-7ad5-4dcb-8d03-10aa1a82ab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:08.361681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 557/1125] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:08.622657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5aa0-8170-4177-bd14-349f2c2aeefc None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:08.681788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:08.744388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5aa0-8170-4177-bd14-349f2c2aeefc None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:08.779695 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54fcea-e033-42f9-a6cf-ff7afc5048bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:08.780317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54fcea-e033-42f9-a6cf-ff7afc5048bf None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:08.780595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54fcea-e033-42f9-a6cf-ff7afc5048bf None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:08.780867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54fcea-e033-42f9-a6cf-ff7afc5048bf None admin] PATH_INFO: `/v3/roles/4111136d5e114c4b9ca719aa39f4bc23` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:08.782371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54fcea-e033-42f9-a6cf-ff7afc5048bf None admin] RBAC: Authorizing `identity:get_role(role_id=4111136d5e114c4b9ca719aa39f4bc23)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:08.783790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54fcea-e033-42f9-a6cf-ff7afc5048bf None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:08.785105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 569/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:08 2022] GET /identity/v3/roles/4111136d5e114c4b9ca719aa39f4bc23 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:08.794386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d2225-7ad5-4dcb-8d03-10aa1a82ab8e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:08.909088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d2225-7ad5-4dcb-8d03-10aa1a82ab8e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:08.951279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63a74f-b64f-4788-b274-900c2febaf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:08.952157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63a74f-b64f-4788-b274-900c2febaf90 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:08.952579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63a74f-b64f-4788-b274-900c2febaf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:08.952995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63a74f-b64f-4788-b274-900c2febaf90 None admin] PATH_INFO: `/v3/users/d557ba6e08614d9b8513527f2acca7c9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:08.954736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63a74f-b64f-4788-b274-900c2febaf90 None admin] RBAC: Authorizing `identity:get_user(user_id=d557ba6e08614d9b8513527f2acca7c9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:08.956659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63a74f-b64f-4788-b274-900c2febaf90 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:08.958874 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 558/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:08 2022] GET /identity/v3/users/d557ba6e08614d9b8513527f2acca7c9 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:08.967280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54fcea-e033-42f9-a6cf-ff7afc5048bf None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:09.078859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54fcea-e033-42f9-a6cf-ff7afc5048bf None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:09.087177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:09.115731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c328b-8d9f-4cc7-b48d-378d53e5cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:09.116332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c328b-8d9f-4cc7-b48d-378d53e5cfff None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:09.116608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c328b-8d9f-4cc7-b48d-378d53e5cfff None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:09.116876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c328b-8d9f-4cc7-b48d-378d53e5cfff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:09.184470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c328b-8d9f-4cc7-b48d-378d53e5cfff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:09.185929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c328b-8d9f-4cc7-b48d-378d53e5cfff None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:09.285943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 570/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:11:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:11:09.293535 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63a74f-b64f-4788-b274-900c2febaf90 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:09.298725 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:09.415791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63a74f-b64f-4788-b274-900c2febaf90 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:09.453465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599cfc0-7871-4e87-87ae-3205ccc51a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:09.453992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599cfc0-7871-4e87-87ae-3205ccc51a2a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:09.454263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599cfc0-7871-4e87-87ae-3205ccc51a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:09.454532 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599cfc0-7871-4e87-87ae-3205ccc51a2a None admin] PATH_INFO: `/v3/projects/8d9e5a32df2546e385f3be466aeb9c29` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:09.455783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599cfc0-7871-4e87-87ae-3205ccc51a2a None admin] RBAC: Authorizing `identity:get_project(project_id=8d9e5a32df2546e385f3be466aeb9c29)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:09.457199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599cfc0-7871-4e87-87ae-3205ccc51a2a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:09.458800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 559/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:11:09 2022] GET /identity/v3/projects/8d9e5a32df2546e385f3be466aeb9c29 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:09.465915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c328b-8d9f-4cc7-b48d-378d53e5cfff None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:09.476468 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:09.586935 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c328b-8d9f-4cc7-b48d-378d53e5cfff None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:09.623812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cb698-05f7-4e65-ac48-7fb657f68e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:09.624407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb698-05f7-4e65-ac48-7fb657f68e58 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:09.624686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb698-05f7-4e65-ac48-7fb657f68e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:09.624955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb698-05f7-4e65-ac48-7fb657f68e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:09.625675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cb698-05f7-4e65-ac48-7fb657f68e58 None admin] RBAC: Adding query filter params (role.id=4111136d5e114c4b9ca719aa39f4bc23, scope.project.id=8d9e5a32df2546e385f3be466aeb9c29, user.id=d557ba6e08614d9b8513527f2acca7c9) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:09.625976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cb698-05f7-4e65-ac48-7fb657f68e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:09.627496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cb698-05f7-4e65-ac48-7fb657f68e58 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:09.633939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 571/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:11:09 2022] GET /identity/v3/role_assignments?user.id=d557ba6e08614d9b8513527f2acca7c9&scope.project.id=8d9e5a32df2546e385f3be466aeb9c29&role.id=4111136d5e114c4b9ca719aa39f4bc23 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:11.586847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce016a-5af9-4989-8b3f-5df4eb55fd95 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:11.587457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce016a-5af9-4989-8b3f-5df4eb55fd95 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:11.587559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce016a-5af9-4989-8b3f-5df4eb55fd95 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:11.588913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 560/1131] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:11.595761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec6837-e439-47a9-95db-923b3903fa95 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:11.596467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec6837-e439-47a9-95db-923b3903fa95 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:11.596566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec6837-e439-47a9-95db-923b3903fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:11.624700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-97ec6837-e439-47a9-95db-923b3903fa95 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:11.625873 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-97ec6837-e439-47a9-95db-923b3903fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:11.695076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 572/1132] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:11.963498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce016a-5af9-4989-8b3f-5df4eb55fd95 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:12.038776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:12.069528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce016a-5af9-4989-8b3f-5df4eb55fd95 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:12.111484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e690743-0429-458e-b274-9a86d3414f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:12.112108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e690743-0429-458e-b274-9a86d3414f08 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:12.112384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e690743-0429-458e-b274-9a86d3414f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:12.112654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e690743-0429-458e-b274-9a86d3414f08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:12.113817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e690743-0429-458e-b274-9a86d3414f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:12.115240 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e690743-0429-458e-b274-9a86d3414f08 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:12.116809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 561/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:11:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:12.123781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec6837-e439-47a9-95db-923b3903fa95 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:12.126954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:12.241554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec6837-e439-47a9-95db-923b3903fa95 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:12.281074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283319b4-db7b-43ab-b680-a046f7c09277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:12.281666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283319b4-db7b-43ab-b680-a046f7c09277 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:12.281942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283319b4-db7b-43ab-b680-a046f7c09277 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:12.282212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283319b4-db7b-43ab-b680-a046f7c09277 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:12.282845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283319b4-db7b-43ab-b680-a046f7c09277 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:12.284303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283319b4-db7b-43ab-b680-a046f7c09277 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:12.315390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 573/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:11:12 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:11:14.242858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e406f5-3e09-4972-bf19-40e301dd76d3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:14.243794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e406f5-3e09-4972-bf19-40e301dd76d3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:14.243794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e406f5-3e09-4972-bf19-40e301dd76d3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:14.245975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 562/1135] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:14.252781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30638d-d1bc-4bb6-921c-0a9900f020ff None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:14.253504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30638d-d1bc-4bb6-921c-0a9900f020ff None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:14.253670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30638d-d1bc-4bb6-921c-0a9900f020ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:14.277100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4f30638d-d1bc-4bb6-921c-0a9900f020ff None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:14.278641 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4f30638d-d1bc-4bb6-921c-0a9900f020ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:14.335124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:14.355218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 574/1136] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:14.625848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e406f5-3e09-4972-bf19-40e301dd76d3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:14.749650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e406f5-3e09-4972-bf19-40e301dd76d3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:14.784735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63538b1e-957c-43a2-a9b9-990cb990012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:14.785356 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538b1e-957c-43a2-a9b9-990cb990012d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:14.785631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538b1e-957c-43a2-a9b9-990cb990012d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:14.785899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538b1e-957c-43a2-a9b9-990cb990012d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:14.787108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63538b1e-957c-43a2-a9b9-990cb990012d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:14.788559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63538b1e-957c-43a2-a9b9-990cb990012d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:14.790136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 563/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:11:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:14.796384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30638d-d1bc-4bb6-921c-0a9900f020ff None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:14.909866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30638d-d1bc-4bb6-921c-0a9900f020ff None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:14.944963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715866e6-71db-4b48-acf9-06b7bc3691a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:14.945547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715866e6-71db-4b48-acf9-06b7bc3691a7 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:14.945819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715866e6-71db-4b48-acf9-06b7bc3691a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:14.946090 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715866e6-71db-4b48-acf9-06b7bc3691a7 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:14.946728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715866e6-71db-4b48-acf9-06b7bc3691a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:14.948194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715866e6-71db-4b48-acf9-06b7bc3691a7 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:14.971772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 575/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:11:14 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:11:16.904502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98f8f5-d705-4c47-b722-66704c78c154 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:16.905092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98f8f5-d705-4c47-b722-66704c78c154 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:16.905092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98f8f5-d705-4c47-b722-66704c78c154 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:16.906407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 564/1139] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:16.912866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d4fa-1c56-49a3-a55e-6236b2f170bf None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:16.913606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d4fa-1c56-49a3-a55e-6236b2f170bf None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:16.913742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d4fa-1c56-49a3-a55e-6236b2f170bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:16.940978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0508d4fa-1c56-49a3-a55e-6236b2f170bf None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:16.942171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0508d4fa-1c56-49a3-a55e-6236b2f170bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:16.978476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:17.013521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 576/1140] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:17.279828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98f8f5-d705-4c47-b722-66704c78c154 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:17.296914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:17.401868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98f8f5-d705-4c47-b722-66704c78c154 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:17.439723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e065-6d18-4e6e-9456-db8ed2d59000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:17.440277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e065-6d18-4e6e-9456-db8ed2d59000 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:17.440535 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e065-6d18-4e6e-9456-db8ed2d59000 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:17.440803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e065-6d18-4e6e-9456-db8ed2d59000 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:17.451193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85e065-6d18-4e6e-9456-db8ed2d59000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6b85e065-6d18-4e6e-9456-db8ed2d59000 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:11:17.455980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:11:17.457059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:11:17.458295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 565/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:11:17.465380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d4fa-1c56-49a3-a55e-6236b2f170bf None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:17.577485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d4fa-1c56-49a3-a55e-6236b2f170bf None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:17.614125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6760e94-b2a5-4dde-b741-9406e3f3223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:17.614728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760e94-b2a5-4dde-b741-9406e3f3223a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:17.615005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760e94-b2a5-4dde-b741-9406e3f3223a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:17.615285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760e94-b2a5-4dde-b741-9406e3f3223a None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:17.615967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6760e94-b2a5-4dde-b741-9406e3f3223a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:17.616268 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6760e94-b2a5-4dde-b741-9406e3f3223a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:17.617659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6760e94-b2a5-4dde-b741-9406e3f3223a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:17.626579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 577/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:17.633116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e065-6d18-4e6e-9456-db8ed2d59000 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:17.710215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:17.745479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e065-6d18-4e6e-9456-db8ed2d59000 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:17.793703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbd994-c09f-433b-93cd-25ce5c959435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:17.794635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbd994-c09f-433b-93cd-25ce5c959435 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:17.794878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbd994-c09f-433b-93cd-25ce5c959435 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:17.795117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbd994-c09f-433b-93cd-25ce5c959435 None admin] PATH_INFO: `/v3/users/e40a41ae1d0d4252bade7624cfb2a1d2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:17.808446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbd994-c09f-433b-93cd-25ce5c959435 None admin] RBAC: Authorizing `identity:get_user(user_id=e40a41ae1d0d4252bade7624cfb2a1d2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:17.811075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbd994-c09f-433b-93cd-25ce5c959435 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:17.813214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 566/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:17 2022] GET /identity/v3/users/e40a41ae1d0d4252bade7624cfb2a1d2 => generated 286 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:17.819358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6760e94-b2a5-4dde-b741-9406e3f3223a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:17.854153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:17.924819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6760e94-b2a5-4dde-b741-9406e3f3223a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:17.964645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a93d1-1ca2-4ef9-9a16-276da62b40dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:17.965188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a93d1-1ca2-4ef9-9a16-276da62b40dc None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:17.965469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a93d1-1ca2-4ef9-9a16-276da62b40dc None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:17.965743 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a93d1-1ca2-4ef9-9a16-276da62b40dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:18.031771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a93d1-1ca2-4ef9-9a16-276da62b40dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:18.033219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a93d1-1ca2-4ef9-9a16-276da62b40dc None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:18.066221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:18.141651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 578/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:11:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:11:18.148588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbd994-c09f-433b-93cd-25ce5c959435 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:18.266228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbd994-c09f-433b-93cd-25ce5c959435 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:18.292034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:18.302159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ae111-19b1-41ce-9fd8-620fc6456a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:18.302800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae111-19b1-41ce-9fd8-620fc6456a3c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:18.303076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae111-19b1-41ce-9fd8-620fc6456a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:18.303378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae111-19b1-41ce-9fd8-620fc6456a3c None admin] PATH_INFO: `/v3/projects/d3e3a6a462ce4f84aa1bba78f1d2739f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:18.304502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ae111-19b1-41ce-9fd8-620fc6456a3c None admin] RBAC: Authorizing `identity:get_project(project_id=d3e3a6a462ce4f84aa1bba78f1d2739f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:18.305926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ae111-19b1-41ce-9fd8-620fc6456a3c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:18.307613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 567/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:11:18 2022] GET /identity/v3/projects/d3e3a6a462ce4f84aa1bba78f1d2739f => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:18.314418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a93d1-1ca2-4ef9-9a16-276da62b40dc None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:18.418030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a93d1-1ca2-4ef9-9a16-276da62b40dc None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:18.449056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:18.455520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ee6f-8639-479f-acec-632d5ddab09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:18.456112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ee6f-8639-479f-acec-632d5ddab09e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:18.456368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ee6f-8639-479f-acec-632d5ddab09e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:18.456661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ee6f-8639-479f-acec-632d5ddab09e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:18.457384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ee6f-8639-479f-acec-632d5ddab09e None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=d3e3a6a462ce4f84aa1bba78f1d2739f, user.id=e40a41ae1d0d4252bade7624cfb2a1d2) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:18.457682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ee6f-8639-479f-acec-632d5ddab09e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:18.459112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ee6f-8639-479f-acec-632d5ddab09e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:18.465332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 579/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:11:18 2022] GET /identity/v3/role_assignments?user.id=e40a41ae1d0d4252bade7624cfb2a1d2&scope.project.id=d3e3a6a462ce4f84aa1bba78f1d2739f&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:20.338912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9b846-2adb-4d4b-9949-3a07bc0bc81d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:20.339846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9b846-2adb-4d4b-9949-3a07bc0bc81d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:20.339846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9b846-2adb-4d4b-9949-3a07bc0bc81d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:20.341880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 568/1147] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:20.348135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b633b98-9788-4d8d-8dcf-f3142c68b84b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:20.348896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b633b98-9788-4d8d-8dcf-f3142c68b84b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:20.349014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b633b98-9788-4d8d-8dcf-f3142c68b84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:20.371517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2b633b98-9788-4d8d-8dcf-f3142c68b84b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:20.372834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2b633b98-9788-4d8d-8dcf-f3142c68b84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:20.447957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 580/1148] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:20.731449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9b846-2adb-4d4b-9949-3a07bc0bc81d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:20.847011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9b846-2adb-4d4b-9949-3a07bc0bc81d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:20.882357 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a47eb-b2b5-4d82-a7ea-1982cda259cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:20.882974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a47eb-b2b5-4d82-a7ea-1982cda259cf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:20.883288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a47eb-b2b5-4d82-a7ea-1982cda259cf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:20.883555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a47eb-b2b5-4d82-a7ea-1982cda259cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:20.894078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a47eb-b2b5-4d82-a7ea-1982cda259cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-539a47eb-b2b5-4d82-a7ea-1982cda259cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:11:20.898923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:11:20.900031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:11:20.900873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 569/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:11:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:11:20.907282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b633b98-9788-4d8d-8dcf-f3142c68b84b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:21.012660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b633b98-9788-4d8d-8dcf-f3142c68b84b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:21.037612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:21.047845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147ee88-223d-45e0-adf6-4e5e6e8a60a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:21.048440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147ee88-223d-45e0-adf6-4e5e6e8a60a4 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:21.048713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147ee88-223d-45e0-adf6-4e5e6e8a60a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:21.048980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147ee88-223d-45e0-adf6-4e5e6e8a60a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:21.049632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147ee88-223d-45e0-adf6-4e5e6e8a60a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:21.049922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147ee88-223d-45e0-adf6-4e5e6e8a60a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:21.051282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147ee88-223d-45e0-adf6-4e5e6e8a60a4 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:21.059544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 581/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:11:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:21.065662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a47eb-b2b5-4d82-a7ea-1982cda259cf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:21.122218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:21.168330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a47eb-b2b5-4d82-a7ea-1982cda259cf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:21.205478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06add0bc-a5d2-40dd-a8cb-eda41e60d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:21.206120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06add0bc-a5d2-40dd-a8cb-eda41e60d213 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:21.206402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06add0bc-a5d2-40dd-a8cb-eda41e60d213 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:21.206673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06add0bc-a5d2-40dd-a8cb-eda41e60d213 None admin] PATH_INFO: `/v3/users/e40a41ae1d0d4252bade7624cfb2a1d2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:21.207849 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06add0bc-a5d2-40dd-a8cb-eda41e60d213 None admin] RBAC: Authorizing `identity:get_user(user_id=e40a41ae1d0d4252bade7624cfb2a1d2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:21.209277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06add0bc-a5d2-40dd-a8cb-eda41e60d213 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:21.210886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 570/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:21 2022] GET /identity/v3/users/e40a41ae1d0d4252bade7624cfb2a1d2 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:21.217172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147ee88-223d-45e0-adf6-4e5e6e8a60a4 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:21.315712 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147ee88-223d-45e0-adf6-4e5e6e8a60a4 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:21.350030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f193c37-99ca-4061-bd4f-8d0c54438de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:21.350625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f193c37-99ca-4061-bd4f-8d0c54438de5 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:21.350900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f193c37-99ca-4061-bd4f-8d0c54438de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:21.351168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f193c37-99ca-4061-bd4f-8d0c54438de5 None admin] PATH_INFO: `/v3/projects/d3e3a6a462ce4f84aa1bba78f1d2739f` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:21.352349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f193c37-99ca-4061-bd4f-8d0c54438de5 None admin] RBAC: Authorizing `identity:get_project(project_id=d3e3a6a462ce4f84aa1bba78f1d2739f)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:21.354120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f193c37-99ca-4061-bd4f-8d0c54438de5 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:21.355767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 582/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:11:21 2022] GET /identity/v3/projects/d3e3a6a462ce4f84aa1bba78f1d2739f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:21.362102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06add0bc-a5d2-40dd-a8cb-eda41e60d213 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:21.464499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06add0bc-a5d2-40dd-a8cb-eda41e60d213 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:21.487445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:21.501129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101fe66-1ca4-42dd-8e02-9df2d9399368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:21.501779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101fe66-1ca4-42dd-8e02-9df2d9399368 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:21.502078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101fe66-1ca4-42dd-8e02-9df2d9399368 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:21.502348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101fe66-1ca4-42dd-8e02-9df2d9399368 None admin] PATH_INFO: `/v3/projects/d3e3a6a462ce4f84aa1bba78f1d2739f/users/e40a41ae1d0d4252bade7624cfb2a1d2/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:21.504259 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101fe66-1ca4-42dd-8e02-9df2d9399368 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3e3a6a462ce4f84aa1bba78f1d2739f, user_id=e40a41ae1d0d4252bade7624cfb2a1d2, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:21.505666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101fe66-1ca4-42dd-8e02-9df2d9399368 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:21.521326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 571/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:11:21 2022] PUT /identity/v3/projects/d3e3a6a462ce4f84aa1bba78f1d2739f/users/e40a41ae1d0d4252bade7624cfb2a1d2/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:11:23.381700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb09a1e-a5b9-4cbe-be06-a6fc5af74184 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:23.382282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb09a1e-a5b9-4cbe-be06-a6fc5af74184 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:23.382282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb09a1e-a5b9-4cbe-be06-a6fc5af74184 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:23.384382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 583/1154] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:23.392199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588aae9-1e8a-4e47-b349-a0ff65ded15b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:23.392600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588aae9-1e8a-4e47-b349-a0ff65ded15b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:23.392778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588aae9-1e8a-4e47-b349-a0ff65ded15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:23.420213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9588aae9-1e8a-4e47-b349-a0ff65ded15b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:23.421407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9588aae9-1e8a-4e47-b349-a0ff65ded15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:23.499167 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 572/1155] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:23.790728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb09a1e-a5b9-4cbe-be06-a6fc5af74184 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:23.857681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:23.904543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb09a1e-a5b9-4cbe-be06-a6fc5af74184 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:23.940389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0b3a5-f922-4bab-a68e-914bd1e324bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:23.941008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0b3a5-f922-4bab-a68e-914bd1e324bf None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:23.941280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0b3a5-f922-4bab-a68e-914bd1e324bf None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:23.941547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0b3a5-f922-4bab-a68e-914bd1e324bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:23.952643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0b3a5-f922-4bab-a68e-914bd1e324bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-ece0b3a5-f922-4bab-a68e-914bd1e324bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:11:23.957409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:11:23.958471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:11:23.959419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 584/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:11:23.964914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588aae9-1e8a-4e47-b349-a0ff65ded15b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:24.076370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588aae9-1e8a-4e47-b349-a0ff65ded15b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:24.089800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:24.113370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d843d0-aadf-4803-a7e1-490e37a8776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:24.113992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d843d0-aadf-4803-a7e1-490e37a8776a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:24.114271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d843d0-aadf-4803-a7e1-490e37a8776a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:24.114543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d843d0-aadf-4803-a7e1-490e37a8776a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:24.115205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d843d0-aadf-4803-a7e1-490e37a8776a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:24.115537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d843d0-aadf-4803-a7e1-490e37a8776a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:24.116905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d843d0-aadf-4803-a7e1-490e37a8776a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:24.125157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 573/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:24.131376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0b3a5-f922-4bab-a68e-914bd1e324bf None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:24.248237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0b3a5-f922-4bab-a68e-914bd1e324bf None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:24.271366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:24.291199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637434f-7bc0-4419-824f-dcfffb56ee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:24.291884 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637434f-7bc0-4419-824f-dcfffb56ee3f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:24.292166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637434f-7bc0-4419-824f-dcfffb56ee3f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:24.292435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637434f-7bc0-4419-824f-dcfffb56ee3f None admin] PATH_INFO: `/v3/users/e40a41ae1d0d4252bade7624cfb2a1d2` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:24.293659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637434f-7bc0-4419-824f-dcfffb56ee3f None admin] RBAC: Authorizing `identity:get_user(user_id=e40a41ae1d0d4252bade7624cfb2a1d2)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:24.295147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637434f-7bc0-4419-824f-dcfffb56ee3f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:24.296774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 585/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:24 2022] GET /identity/v3/users/e40a41ae1d0d4252bade7624cfb2a1d2 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:11:24.305906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d843d0-aadf-4803-a7e1-490e37a8776a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:24.424470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d843d0-aadf-4803-a7e1-490e37a8776a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:24.465657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae46f1-9388-4e21-a37c-1f954c5a2fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:24.466261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae46f1-9388-4e21-a37c-1f954c5a2fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:24.466539 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae46f1-9388-4e21-a37c-1f954c5a2fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:24.466810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae46f1-9388-4e21-a37c-1f954c5a2fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:24.509484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:24.536629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae46f1-9388-4e21-a37c-1f954c5a2fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:24.538059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae46f1-9388-4e21-a37c-1f954c5a2fd7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:24.648736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 574/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:11:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:11:24.657058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637434f-7bc0-4419-824f-dcfffb56ee3f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:24.770035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637434f-7bc0-4419-824f-dcfffb56ee3f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:24.807408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7197f-672e-407a-8115-ad8eaac884b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:24.808018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7197f-672e-407a-8115-ad8eaac884b7 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:24.808295 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7197f-672e-407a-8115-ad8eaac884b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:24.808562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7197f-672e-407a-8115-ad8eaac884b7 None admin] PATH_INFO: `/v3/projects/d3e3a6a462ce4f84aa1bba78f1d2739f` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:24.810147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7197f-672e-407a-8115-ad8eaac884b7 None admin] RBAC: Authorizing `identity:get_project(project_id=d3e3a6a462ce4f84aa1bba78f1d2739f)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:24.811630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7197f-672e-407a-8115-ad8eaac884b7 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:24.813263 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 586/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:11:24 2022] GET /identity/v3/projects/d3e3a6a462ce4f84aa1bba78f1d2739f => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:24.823018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae46f1-9388-4e21-a37c-1f954c5a2fd7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:24.898166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:24.932709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae46f1-9388-4e21-a37c-1f954c5a2fd7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:24.967839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1a1ea-72ce-4dba-9779-3dc66c676682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:24.968436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1a1ea-72ce-4dba-9779-3dc66c676682 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:24.968714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1a1ea-72ce-4dba-9779-3dc66c676682 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:24.968980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1a1ea-72ce-4dba-9779-3dc66c676682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:24.969674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1a1ea-72ce-4dba-9779-3dc66c676682 None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=d3e3a6a462ce4f84aa1bba78f1d2739f, user.id=e40a41ae1d0d4252bade7624cfb2a1d2) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:24.970006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1a1ea-72ce-4dba-9779-3dc66c676682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:24.971448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1a1ea-72ce-4dba-9779-3dc66c676682 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:24.977255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 575/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:11:24 2022] GET /identity/v3/role_assignments?user.id=e40a41ae1d0d4252bade7624cfb2a1d2&scope.project.id=d3e3a6a462ce4f84aa1bba78f1d2739f&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:26.897782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6ce71-e9b4-4d77-bff1-f37e69fefc6b None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:26.899019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6ce71-e9b4-4d77-bff1-f37e69fefc6b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:26.899283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6ce71-e9b4-4d77-bff1-f37e69fefc6b None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:26.902265 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 587/1162] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:26.908195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6192a33-6351-425f-92e6-ac61e7bb763c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:26.908655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6192a33-6351-425f-92e6-ac61e7bb763c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:26.908767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6192a33-6351-425f-92e6-ac61e7bb763c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:26.931109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a6192a33-6351-425f-92e6-ac61e7bb763c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:26.932340 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a6192a33-6351-425f-92e6-ac61e7bb763c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:27.012004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 576/1163] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:11:27.353198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6ce71-e9b4-4d77-bff1-f37e69fefc6b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:27.427846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:27.486245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6ce71-e9b4-4d77-bff1-f37e69fefc6b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:27.529731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8facc-ad61-4b32-93f0-6808d1c9ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:27.530327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8facc-ad61-4b32-93f0-6808d1c9ecba None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:27.530576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8facc-ad61-4b32-93f0-6808d1c9ecba None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:27.530897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8facc-ad61-4b32-93f0-6808d1c9ecba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:27.615991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8facc-ad61-4b32-93f0-6808d1c9ecba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:27.617470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8facc-ad61-4b32-93f0-6808d1c9ecba None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:27.678063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:27.731578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 588/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:11:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 03 01:11:27.740703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6192a33-6351-425f-92e6-ac61e7bb763c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:27.816444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:27.851732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6192a33-6351-425f-92e6-ac61e7bb763c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:27.884500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa1b18-3400-432d-b91f-d5e0533f757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:27.885124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa1b18-3400-432d-b91f-d5e0533f757f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:27.885397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa1b18-3400-432d-b91f-d5e0533f757f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:27.885661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa1b18-3400-432d-b91f-d5e0533f757f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:27.892262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa1b18-3400-432d-b91f-d5e0533f757f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:27.893687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa1b18-3400-432d-b91f-d5e0533f757f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-cbfa1b18-3400-432d-b91f-d5e0533f757f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:11:27.905686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:11:27.906882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:11:27.908116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 577/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Sep 3 01:11:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:11:27.913032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8facc-ad61-4b32-93f0-6808d1c9ecba None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:28.015633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8facc-ad61-4b32-93f0-6808d1c9ecba None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:28.050168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8628e8-e213-42eb-8e8e-a4ced499424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:28.050756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8628e8-e213-42eb-8e8e-a4ced499424b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:28.051027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8628e8-e213-42eb-8e8e-a4ced499424b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:28.051297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8628e8-e213-42eb-8e8e-a4ced499424b None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:28.051943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8628e8-e213-42eb-8e8e-a4ced499424b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:28.052244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8628e8-e213-42eb-8e8e-a4ced499424b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:28.053612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8628e8-e213-42eb-8e8e-a4ced499424b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:28.061245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 589/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Sep 3 01:11:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:29.959937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e30511-e36e-4c5f-a46b-cae3b9612ca0 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:29.960489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e30511-e36e-4c5f-a46b-cae3b9612ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:29.960489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e30511-e36e-4c5f-a46b-cae3b9612ca0 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:29.962512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 578/1167] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:29.971224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ed73a-21fb-4cba-a28e-f77fd821a264 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:29.971667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ed73a-21fb-4cba-a28e-f77fd821a264 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:29.971849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ed73a-21fb-4cba-a28e-f77fd821a264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:29.995816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a50ed73a-21fb-4cba-a28e-f77fd821a264 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:29.997037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a50ed73a-21fb-4cba-a28e-f77fd821a264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:30.009123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:30.069885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 590/1168] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:30.347559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e30511-e36e-4c5f-a46b-cae3b9612ca0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:30.464714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e30511-e36e-4c5f-a46b-cae3b9612ca0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:30.494112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:30.504028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e730d-f52e-4b13-88fd-64391969db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:30.504629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e730d-f52e-4b13-88fd-64391969db7a None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:30.504906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e730d-f52e-4b13-88fd-64391969db7a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:30.505172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e730d-f52e-4b13-88fd-64391969db7a None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:30.505834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e730d-f52e-4b13-88fd-64391969db7a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:30.507186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e730d-f52e-4b13-88fd-64391969db7a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:30.526941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 579/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Sat Sep 3 01:11:30 2022] POST /identity/v3/domains => generated 267 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:11:32.444090 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7f48-4bfc-42ff-9657-7848b902d014 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:32.444893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7f48-4bfc-42ff-9657-7848b902d014 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:32.444893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7f48-4bfc-42ff-9657-7848b902d014 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:32.447054 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 591/1170] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:32.452564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcf6a9-58e2-4610-87fb-4061e022db8d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:32.453002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcf6a9-58e2-4610-87fb-4061e022db8d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:32.453099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcf6a9-58e2-4610-87fb-4061e022db8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:32.474529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-87dcf6a9-58e2-4610-87fb-4061e022db8d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:32.475770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-87dcf6a9-58e2-4610-87fb-4061e022db8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:32.546452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 580/1171] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:32.823684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7f48-4bfc-42ff-9657-7848b902d014 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:32.937044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7f48-4bfc-42ff-9657-7848b902d014 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:32.972738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab679f-9e07-4610-a7cd-309de7b0c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:32.973353 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab679f-9e07-4610-a7cd-309de7b0c808 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:32.973633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab679f-9e07-4610-a7cd-309de7b0c808 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:32.973903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab679f-9e07-4610-a7cd-309de7b0c808 None admin] PATH_INFO: `/v3/domains/7c52dbfa523c4f43a88027be9f4b6fac` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:32.988859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab679f-9e07-4610-a7cd-309de7b0c808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7c52dbfa523c4f43a88027be9f4b6fac)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:32.991180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab679f-9e07-4610-a7cd-309de7b0c808 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:32.993867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 592/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Sat Sep 3 01:11:32 2022] GET /identity/v3/domains/7c52dbfa523c4f43a88027be9f4b6fac => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:11:33.000742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcf6a9-58e2-4610-87fb-4061e022db8d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:33.107327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcf6a9-58e2-4610-87fb-4061e022db8d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:33.124361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:33.144669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85249ed-bd60-4fed-8e98-21dbdd54a839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:33.145299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85249ed-bd60-4fed-8e98-21dbdd54a839 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:33.145571 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85249ed-bd60-4fed-8e98-21dbdd54a839 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:33.145841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85249ed-bd60-4fed-8e98-21dbdd54a839 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:33.146483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85249ed-bd60-4fed-8e98-21dbdd54a839 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:33.147944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85249ed-bd60-4fed-8e98-21dbdd54a839 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:33.177698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 581/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:11:32 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:11:35.108514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6834f-1862-491c-b429-55e3531c8052 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:35.109075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6834f-1862-491c-b429-55e3531c8052 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:35.109075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6834f-1862-491c-b429-55e3531c8052 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:35.110408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 593/1174] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:35.116382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d77d7-f3d2-49f7-a876-2b6bcc639cbe None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:35.117123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d77d7-f3d2-49f7-a876-2b6bcc639cbe None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:35.117250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d77d7-f3d2-49f7-a876-2b6bcc639cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:35.144127 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-270d77d7-f3d2-49f7-a876-2b6bcc639cbe None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:35.145314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-270d77d7-f3d2-49f7-a876-2b6bcc639cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:35.216718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 582/1175] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:35.482642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6834f-1862-491c-b429-55e3531c8052 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:35.493283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:35.593135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6834f-1862-491c-b429-55e3531c8052 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:35.628595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32240d-fc18-465a-bb7f-087fc6edc3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:35.629278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32240d-fc18-465a-bb7f-087fc6edc3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:35.629549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32240d-fc18-465a-bb7f-087fc6edc3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:35.629817 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32240d-fc18-465a-bb7f-087fc6edc3a1 None admin] PATH_INFO: `/v3/domains/7c52dbfa523c4f43a88027be9f4b6fac` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:35.630956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32240d-fc18-465a-bb7f-087fc6edc3a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7c52dbfa523c4f43a88027be9f4b6fac)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:35.632414 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32240d-fc18-465a-bb7f-087fc6edc3a1 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:35.633978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 594/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Sat Sep 3 01:11:35 2022] GET /identity/v3/domains/7c52dbfa523c4f43a88027be9f4b6fac => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:35.641030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d77d7-f3d2-49f7-a876-2b6bcc639cbe None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:35.743797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:35.747232 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d77d7-f3d2-49f7-a876-2b6bcc639cbe None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:35.782526 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c992e-a70e-4016-af6e-7ce67779c274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:35.783128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c992e-a70e-4016-af6e-7ce67779c274 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:35.783439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c992e-a70e-4016-af6e-7ce67779c274 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:35.783706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c992e-a70e-4016-af6e-7ce67779c274 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:35.784346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c992e-a70e-4016-af6e-7ce67779c274 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:35.785761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c992e-a70e-4016-af6e-7ce67779c274 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:35.812827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 583/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:11:35 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:11:37.789213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8400d90-22e5-442d-8f93-e8a81430bbcb None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:37.789856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8400d90-22e5-442d-8f93-e8a81430bbcb None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:37.789856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8400d90-22e5-442d-8f93-e8a81430bbcb None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:37.791782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 595/1178] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:37.800112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef3de-0f97-4784-be9f-8dad00b71dda None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:37.800583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef3de-0f97-4784-be9f-8dad00b71dda None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:37.800682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef3de-0f97-4784-be9f-8dad00b71dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:37.820584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-283ef3de-0f97-4784-be9f-8dad00b71dda None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:37.821765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-283ef3de-0f97-4784-be9f-8dad00b71dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:37.894462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 584/1179] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:38.168447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8400d90-22e5-442d-8f93-e8a81430bbcb None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:38.249888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:38.280627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8400d90-22e5-442d-8f93-e8a81430bbcb None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:38.316298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40975ac6-3c43-4077-8fa0-42e801fb4c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:38.316950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40975ac6-3c43-4077-8fa0-42e801fb4c60 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:38.317229 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40975ac6-3c43-4077-8fa0-42e801fb4c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:38.317495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40975ac6-3c43-4077-8fa0-42e801fb4c60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:38.327583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40975ac6-3c43-4077-8fa0-42e801fb4c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-40975ac6-3c43-4077-8fa0-42e801fb4c60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:11:38.332309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:11:38.333494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:38.334600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:11:38.338357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 596/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:11:38.339632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ef3de-0f97-4784-be9f-8dad00b71dda None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:38.430038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:38.446500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ef3de-0f97-4784-be9f-8dad00b71dda None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:38.490397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8772e47-40ca-49e8-907c-85c06ac6cf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:38.491337 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8772e47-40ca-49e8-907c-85c06ac6cf7c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:38.491613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8772e47-40ca-49e8-907c-85c06ac6cf7c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:38.491937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8772e47-40ca-49e8-907c-85c06ac6cf7c None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:38.492916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8772e47-40ca-49e8-907c-85c06ac6cf7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:38.493351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8772e47-40ca-49e8-907c-85c06ac6cf7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:38.495457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8772e47-40ca-49e8-907c-85c06ac6cf7c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:38.504306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 585/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:11:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:38.510304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40975ac6-3c43-4077-8fa0-42e801fb4c60 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:38.627129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40975ac6-3c43-4077-8fa0-42e801fb4c60 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:38.662423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedf463-a44d-4978-9c44-f95a23d4dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:38.663037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf463-a44d-4978-9c44-f95a23d4dfbe None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:38.663340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf463-a44d-4978-9c44-f95a23d4dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:38.663615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf463-a44d-4978-9c44-f95a23d4dfbe None admin] PATH_INFO: `/v3/users/c4d53c71ac6d43ad888e1f260f1a8381` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:38.665587 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:38.678489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedf463-a44d-4978-9c44-f95a23d4dfbe None admin] RBAC: Authorizing `identity:get_user(user_id=c4d53c71ac6d43ad888e1f260f1a8381)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:38.679986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedf463-a44d-4978-9c44-f95a23d4dfbe None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:38.681677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 597/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:38 2022] GET /identity/v3/users/c4d53c71ac6d43ad888e1f260f1a8381 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:11:38.691388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8772e47-40ca-49e8-907c-85c06ac6cf7c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:38.800703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8772e47-40ca-49e8-907c-85c06ac6cf7c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:38.836475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a0361-58de-40c9-a726-04f9d95f458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:38.837069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0361-58de-40c9-a726-04f9d95f458e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:38.837345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0361-58de-40c9-a726-04f9d95f458e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:38.837615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0361-58de-40c9-a726-04f9d95f458e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:38.855017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:38.919094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a0361-58de-40c9-a726-04f9d95f458e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:38.920584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a0361-58de-40c9-a726-04f9d95f458e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:39.020897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 586/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:11:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:11:39.027292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedf463-a44d-4978-9c44-f95a23d4dfbe None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:39.135148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedf463-a44d-4978-9c44-f95a23d4dfbe None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:39.170696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff37631-7353-4610-984c-522ff1b7de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:39.171335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff37631-7353-4610-984c-522ff1b7de98 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:39.171611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff37631-7353-4610-984c-522ff1b7de98 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:39.171885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff37631-7353-4610-984c-522ff1b7de98 None admin] PATH_INFO: `/v3/projects/67467ee142124444a4413378e21d1722` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:39.173105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff37631-7353-4610-984c-522ff1b7de98 None admin] RBAC: Authorizing `identity:get_project(project_id=67467ee142124444a4413378e21d1722)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:39.174542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff37631-7353-4610-984c-522ff1b7de98 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:39.176429 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 598/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:11:39 2022] GET /identity/v3/projects/67467ee142124444a4413378e21d1722 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:39.183156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a0361-58de-40c9-a726-04f9d95f458e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:39.246114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:39.307223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a0361-58de-40c9-a726-04f9d95f458e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:39.343279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69481c38-f4b0-4705-afd4-4ec7a1b58f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:39.343909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481c38-f4b0-4705-afd4-4ec7a1b58f52 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:39.344178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481c38-f4b0-4705-afd4-4ec7a1b58f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:39.344429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481c38-f4b0-4705-afd4-4ec7a1b58f52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:39.345146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69481c38-f4b0-4705-afd4-4ec7a1b58f52 None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=67467ee142124444a4413378e21d1722, user.id=c4d53c71ac6d43ad888e1f260f1a8381) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:39.345452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69481c38-f4b0-4705-afd4-4ec7a1b58f52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:39.346861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69481c38-f4b0-4705-afd4-4ec7a1b58f52 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:39.352610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 587/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:11:39 2022] GET /identity/v3/role_assignments?user.id=c4d53c71ac6d43ad888e1f260f1a8381&scope.project.id=67467ee142124444a4413378e21d1722&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:41.208678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcb939-e1e8-411b-8a3f-b9a3b0644e11 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:41.209211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcb939-e1e8-411b-8a3f-b9a3b0644e11 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:41.209211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcb939-e1e8-411b-8a3f-b9a3b0644e11 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:41.210567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 599/1186] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:41.216963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c919742-aa0d-4093-9853-e16f48d5a686 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:41.217721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c919742-aa0d-4093-9853-e16f48d5a686 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:41.217872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c919742-aa0d-4093-9853-e16f48d5a686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:41.248430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9c919742-aa0d-4093-9853-e16f48d5a686 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:41.249630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9c919742-aa0d-4093-9853-e16f48d5a686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:41.324883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 588/1187] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:41.588948 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcb939-e1e8-411b-8a3f-b9a3b0644e11 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:41.659508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:41.704593 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcb939-e1e8-411b-8a3f-b9a3b0644e11 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:41.743407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b9259-8cb3-438d-8a1d-c72859032d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:41.744038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b9259-8cb3-438d-8a1d-c72859032d4b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:41.744312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b9259-8cb3-438d-8a1d-c72859032d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:41.744579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b9259-8cb3-438d-8a1d-c72859032d4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:41.756616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b9259-8cb3-438d-8a1d-c72859032d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-af9b9259-8cb3-438d-8a1d-c72859032d4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:11:41.761753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:11:41.763000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:11:41.764117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 600/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:11:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:11:41.774892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c919742-aa0d-4093-9853-e16f48d5a686 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:41.827653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:41.897132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c919742-aa0d-4093-9853-e16f48d5a686 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:41.933138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bcaa7-5a85-421b-9d20-bffc13145fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:41.934057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bcaa7-5a85-421b-9d20-bffc13145fbe None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:41.934334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bcaa7-5a85-421b-9d20-bffc13145fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:41.934603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bcaa7-5a85-421b-9d20-bffc13145fbe None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:41.935286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bcaa7-5a85-421b-9d20-bffc13145fbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:41.935596 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bcaa7-5a85-421b-9d20-bffc13145fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:41.936964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bcaa7-5a85-421b-9d20-bffc13145fbe None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:41.945086 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 589/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:11:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:41.951468 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b9259-8cb3-438d-8a1d-c72859032d4b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:42.066447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b9259-8cb3-438d-8a1d-c72859032d4b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:42.091832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:42.109307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ade84-a9da-4cc2-9721-9492dd49c9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:42.109933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ade84-a9da-4cc2-9721-9492dd49c9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:42.110209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ade84-a9da-4cc2-9721-9492dd49c9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:42.110477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ade84-a9da-4cc2-9721-9492dd49c9a6 None admin] PATH_INFO: `/v3/users/c4d53c71ac6d43ad888e1f260f1a8381` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:42.111717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ade84-a9da-4cc2-9721-9492dd49c9a6 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d53c71ac6d43ad888e1f260f1a8381)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:42.113170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ade84-a9da-4cc2-9721-9492dd49c9a6 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:42.114754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 601/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:41 2022] GET /identity/v3/users/c4d53c71ac6d43ad888e1f260f1a8381 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:42.121300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bcaa7-5a85-421b-9d20-bffc13145fbe None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:42.222679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bcaa7-5a85-421b-9d20-bffc13145fbe None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:42.225007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:42.264743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffc329-4ba6-44bb-8dc6-8c3bc424918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:42.265364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffc329-4ba6-44bb-8dc6-8c3bc424918f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:42.265636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffc329-4ba6-44bb-8dc6-8c3bc424918f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:42.265901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffc329-4ba6-44bb-8dc6-8c3bc424918f None admin] PATH_INFO: `/v3/projects/67467ee142124444a4413378e21d1722` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:42.267004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffc329-4ba6-44bb-8dc6-8c3bc424918f None admin] RBAC: Authorizing `identity:get_project(project_id=67467ee142124444a4413378e21d1722)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:42.268457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffc329-4ba6-44bb-8dc6-8c3bc424918f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:42.270094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 590/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:11:42 2022] GET /identity/v3/projects/67467ee142124444a4413378e21d1722 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:42.276236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ade84-a9da-4cc2-9721-9492dd49c9a6 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:42.377865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ade84-a9da-4cc2-9721-9492dd49c9a6 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:42.411808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3cfde-30a9-4fe6-9a79-86d7d229155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:42.412442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3cfde-30a9-4fe6-9a79-86d7d229155b None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:42.412718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3cfde-30a9-4fe6-9a79-86d7d229155b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:42.412982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3cfde-30a9-4fe6-9a79-86d7d229155b None admin] PATH_INFO: `/v3/projects/67467ee142124444a4413378e21d1722/users/c4d53c71ac6d43ad888e1f260f1a8381/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:42.415117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3cfde-30a9-4fe6-9a79-86d7d229155b None admin] RBAC: Authorizing `identity:create_grant(project_id=67467ee142124444a4413378e21d1722, user_id=c4d53c71ac6d43ad888e1f260f1a8381, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:42.416572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3cfde-30a9-4fe6-9a79-86d7d229155b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:42.435128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 602/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:11:42 2022] PUT /identity/v3/projects/67467ee142124444a4413378e21d1722/users/c4d53c71ac6d43ad888e1f260f1a8381/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:11:44.272310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b48094-29fc-4abe-bd31-6a4ffb2224df None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:44.273192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b48094-29fc-4abe-bd31-6a4ffb2224df None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:44.273192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b48094-29fc-4abe-bd31-6a4ffb2224df None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:44.275429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 591/1193] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:11:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:11:44.280791 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084443b0-c23b-4ab9-b34b-0d79be36df83 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:44.281206 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084443b0-c23b-4ab9-b34b-0d79be36df83 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:44.281317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084443b0-c23b-4ab9-b34b-0d79be36df83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:44.300984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-084443b0-c23b-4ab9-b34b-0d79be36df83 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:11:44.302157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-084443b0-c23b-4ab9-b34b-0d79be36df83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:11:44.347122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:44.380378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 603/1194] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:11:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:11:44.648497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b48094-29fc-4abe-bd31-6a4ffb2224df None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:44.760567 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b48094-29fc-4abe-bd31-6a4ffb2224df None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:44.800447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54249c-ccd5-4073-ac79-454d9b7458f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:44.801074 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54249c-ccd5-4073-ac79-454d9b7458f1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:44.801349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54249c-ccd5-4073-ac79-454d9b7458f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:44.801612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54249c-ccd5-4073-ac79-454d9b7458f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:44.812311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54249c-ccd5-4073-ac79-454d9b7458f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-be54249c-ccd5-4073-ac79-454d9b7458f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:11:44.817114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:11:44.818192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:11:44.819238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 592/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:11:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:11:44.824386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084443b0-c23b-4ab9-b34b-0d79be36df83 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:44.926221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084443b0-c23b-4ab9-b34b-0d79be36df83 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:44.963447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e0445-4da4-42a3-afc1-81a4039d39bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:44.964086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e0445-4da4-42a3-afc1-81a4039d39bc None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:44.964768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e0445-4da4-42a3-afc1-81a4039d39bc None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:44.964768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e0445-4da4-42a3-afc1-81a4039d39bc None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:44.965280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e0445-4da4-42a3-afc1-81a4039d39bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:44.965619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e0445-4da4-42a3-afc1-81a4039d39bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:44.966965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e0445-4da4-42a3-afc1-81a4039d39bc None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:44.975439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 604/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:11:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:44.982465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54249c-ccd5-4073-ac79-454d9b7458f1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:45.021467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:45.093218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54249c-ccd5-4073-ac79-454d9b7458f1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:45.129223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124ea3-563d-4376-b930-57367ab9dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:45.129847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124ea3-563d-4376-b930-57367ab9dcf5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:45.130119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124ea3-563d-4376-b930-57367ab9dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:45.130383 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124ea3-563d-4376-b930-57367ab9dcf5 None admin] PATH_INFO: `/v3/users/c4d53c71ac6d43ad888e1f260f1a8381` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:45.131642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124ea3-563d-4376-b930-57367ab9dcf5 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d53c71ac6d43ad888e1f260f1a8381)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:45.133057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124ea3-563d-4376-b930-57367ab9dcf5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:45.134623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 593/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Sep 3 01:11:44 2022] GET /identity/v3/users/c4d53c71ac6d43ad888e1f260f1a8381 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:45.144855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e0445-4da4-42a3-afc1-81a4039d39bc None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:45.192403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:45.247667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e0445-4da4-42a3-afc1-81a4039d39bc None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:45.285841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961fa29-1e7f-4a9d-8043-8d7e951d5146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:45.286439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961fa29-1e7f-4a9d-8043-8d7e951d5146 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:45.286691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961fa29-1e7f-4a9d-8043-8d7e951d5146 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:45.286947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961fa29-1e7f-4a9d-8043-8d7e951d5146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:45.358610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961fa29-1e7f-4a9d-8043-8d7e951d5146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:45.360067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961fa29-1e7f-4a9d-8043-8d7e951d5146 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:45.399437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:45.459365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 605/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:11:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:11:45.465780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124ea3-563d-4376-b930-57367ab9dcf5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:45.574813 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:45.578302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124ea3-563d-4376-b930-57367ab9dcf5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:45.616785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da8dc5-5067-4eb5-8da3-4c4f2f05de70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:45.617406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da8dc5-5067-4eb5-8da3-4c4f2f05de70 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:45.617676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da8dc5-5067-4eb5-8da3-4c4f2f05de70 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:45.617940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da8dc5-5067-4eb5-8da3-4c4f2f05de70 None admin] PATH_INFO: `/v3/projects/67467ee142124444a4413378e21d1722` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:45.619080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da8dc5-5067-4eb5-8da3-4c4f2f05de70 None admin] RBAC: Authorizing `identity:get_project(project_id=67467ee142124444a4413378e21d1722)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:45.620573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da8dc5-5067-4eb5-8da3-4c4f2f05de70 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:45.622224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 594/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Sep 3 01:11:45 2022] GET /identity/v3/projects/67467ee142124444a4413378e21d1722 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:45.628825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961fa29-1e7f-4a9d-8043-8d7e951d5146 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:11:45.742097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961fa29-1e7f-4a9d-8043-8d7e951d5146 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:11:45.777657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567a32c-e8de-4fdb-a759-ef6282c64d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:11:45.778245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567a32c-e8de-4fdb-a759-ef6282c64d09 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:11:45.778518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567a32c-e8de-4fdb-a759-ef6282c64d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:11:45.778782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567a32c-e8de-4fdb-a759-ef6282c64d09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:11:45.779530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567a32c-e8de-4fdb-a759-ef6282c64d09 None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=67467ee142124444a4413378e21d1722, user.id=c4d53c71ac6d43ad888e1f260f1a8381) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:11:45.779818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567a32c-e8de-4fdb-a759-ef6282c64d09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:11:45.781238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567a32c-e8de-4fdb-a759-ef6282c64d09 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:11:45.787165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 606/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:11:45 2022] GET /identity/v3/role_assignments?user.id=c4d53c71ac6d43ad888e1f260f1a8381&scope.project.id=67467ee142124444a4413378e21d1722&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:11:55.612486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=16 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:11:55.784505 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:41.660795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73b97-21b4-49f3-9615-9b04dc211b62 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:41.661422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73b97-21b4-49f3-9615-9b04dc211b62 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:41.661422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73b97-21b4-49f3-9615-9b04dc211b62 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:41.662831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 595/1201] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:12:41.671050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181d9f5-b071-465c-8c7f-40d5a9354ef8 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:41.671050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181d9f5-b071-465c-8c7f-40d5a9354ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:41.671050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181d9f5-b071-465c-8c7f-40d5a9354ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:41.690011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3181d9f5-b071-465c-8c7f-40d5a9354ef8 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:12:41.691216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3181d9f5-b071-465c-8c7f-40d5a9354ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:12:41.770987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 607/1202] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:12:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:12:42.057171 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c73b97-21b4-49f3-9615-9b04dc211b62 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:42.206773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c73b97-21b4-49f3-9615-9b04dc211b62 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:42.248141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec511e3-628e-446b-a824-0e67ea534fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:42.248878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec511e3-628e-446b-a824-0e67ea534fde None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:42.249166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec511e3-628e-446b-a824-0e67ea534fde None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:42.249467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec511e3-628e-446b-a824-0e67ea534fde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:42.260843 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec511e3-628e-446b-a824-0e67ea534fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:42.262475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec511e3-628e-446b-a824-0e67ea534fde None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8ec511e3-628e-446b-a824-0e67ea534fde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:12:42.280152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:42.281370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:12:42.282363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:12:42.282363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:42.282363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:12:42.282363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 596/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:42.287626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181d9f5-b071-465c-8c7f-40d5a9354ef8 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:42.408974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181d9f5-b071-465c-8c7f-40d5a9354ef8 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:42.443452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:42.450737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329b2c3-2027-4a95-90ce-f697d38be8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:42.451848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b2c3-2027-4a95-90ce-f697d38be8df None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:42.452315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b2c3-2027-4a95-90ce-f697d38be8df None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:42.452759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b2c3-2027-4a95-90ce-f697d38be8df None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:42.453552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329b2c3-2027-4a95-90ce-f697d38be8df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:42.453865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329b2c3-2027-4a95-90ce-f697d38be8df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:42.455347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329b2c3-2027-4a95-90ce-f697d38be8df None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:42.469247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 608/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:42.475509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec511e3-628e-446b-a824-0e67ea534fde None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:42.545944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:42.626475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec511e3-628e-446b-a824-0e67ea534fde None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:42.673537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e949069-1aef-4e66-b983-b4eeacb68e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:42.674506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e949069-1aef-4e66-b983-b4eeacb68e76 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:42.674779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e949069-1aef-4e66-b983-b4eeacb68e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:42.675043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e949069-1aef-4e66-b983-b4eeacb68e76 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:42.675721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e949069-1aef-4e66-b983-b4eeacb68e76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:42.677138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e949069-1aef-4e66-b983-b4eeacb68e76 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:42.702011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 597/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Sep 3 01:12:42 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:12:44.918343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036037a-8bad-4500-a1fc-d1b903f033e5 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:44.919353 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036037a-8bad-4500-a1fc-d1b903f033e5 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:44.919669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036037a-8bad-4500-a1fc-d1b903f033e5 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:44.921241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 609/1206] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:12:44.927106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3906-f345-4c7e-82e2-514751597c5f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:44.927599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3906-f345-4c7e-82e2-514751597c5f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:44.927794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3906-f345-4c7e-82e2-514751597c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:44.947234 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-af4f3906-f345-4c7e-82e2-514751597c5f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:12:44.948602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-af4f3906-f345-4c7e-82e2-514751597c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:12:45.024040 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 598/1207] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:12:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:12:45.290259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036037a-8bad-4500-a1fc-d1b903f033e5 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:45.417197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036037a-8bad-4500-a1fc-d1b903f033e5 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:45.457267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e47c96-3572-4fe8-8c2f-b8fd4fb770bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:45.457893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47c96-3572-4fe8-8c2f-b8fd4fb770bb None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:45.458263 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47c96-3572-4fe8-8c2f-b8fd4fb770bb None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:45.458666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47c96-3572-4fe8-8c2f-b8fd4fb770bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:45.473427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e47c96-3572-4fe8-8c2f-b8fd4fb770bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-28e47c96-3572-4fe8-8c2f-b8fd4fb770bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:12:45.478822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:45.483452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:12:45.484439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 610/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:12:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:45.486453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3906-f345-4c7e-82e2-514751597c5f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:45.535587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:45.615322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3906-f345-4c7e-82e2-514751597c5f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:45.653718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb665ce-5b7e-42d4-9247-2203181c389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:45.654409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb665ce-5b7e-42d4-9247-2203181c389c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:45.654695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb665ce-5b7e-42d4-9247-2203181c389c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:45.654966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb665ce-5b7e-42d4-9247-2203181c389c None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:45.655692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb665ce-5b7e-42d4-9247-2203181c389c None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:45.656000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb665ce-5b7e-42d4-9247-2203181c389c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:45.657522 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb665ce-5b7e-42d4-9247-2203181c389c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:45.667566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 599/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:12:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:45.673732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e47c96-3572-4fe8-8c2f-b8fd4fb770bb None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:45.732286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:45.785189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e47c96-3572-4fe8-8c2f-b8fd4fb770bb None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:45.820135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf8886-fb5c-4f78-b67d-c02c55fd5993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:45.820762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf8886-fb5c-4f78-b67d-c02c55fd5993 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:45.821037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf8886-fb5c-4f78-b67d-c02c55fd5993 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:45.821304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf8886-fb5c-4f78-b67d-c02c55fd5993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:45.831939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf8886-fb5c-4f78-b67d-c02c55fd5993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:45.833424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf8886-fb5c-4f78-b67d-c02c55fd5993 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-afbf8886-fb5c-4f78-b67d-c02c55fd5993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:12:45.848278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:45.854926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:12:45.856252 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:12:45.856252 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:45.856252 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:12:45.856252 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 611/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:45.856623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb665ce-5b7e-42d4-9247-2203181c389c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:45.968653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:45.972075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb665ce-5b7e-42d4-9247-2203181c389c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:46.009355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c0fb3-342c-4571-8ed0-8338bb282bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:46.009901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c0fb3-342c-4571-8ed0-8338bb282bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:46.010253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c0fb3-342c-4571-8ed0-8338bb282bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:46.010550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c0fb3-342c-4571-8ed0-8338bb282bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:46.011197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c0fb3-342c-4571-8ed0-8338bb282bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:46.011583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c0fb3-342c-4571-8ed0-8338bb282bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:46.013522 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c0fb3-342c-4571-8ed0-8338bb282bc1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:46.029055 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 600/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:12:46.033011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf8886-fb5c-4f78-b67d-c02c55fd5993 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:46.148022 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf8886-fb5c-4f78-b67d-c02c55fd5993 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:46.149772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:46.186701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e746-e420-49f3-89ac-a637d124a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:46.187489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e746-e420-49f3-89ac-a637d124a95e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:46.187750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e746-e420-49f3-89ac-a637d124a95e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:46.188080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e746-e420-49f3-89ac-a637d124a95e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:46.196587 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293e746-e420-49f3-89ac-a637d124a95e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:46.198187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293e746-e420-49f3-89ac-a637d124a95e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-e293e746-e420-49f3-89ac-a637d124a95e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:12:46.212356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:46.214886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:12:46.215972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 612/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:46.220232 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c0fb3-342c-4571-8ed0-8338bb282bc1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:46.344680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c0fb3-342c-4571-8ed0-8338bb282bc1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:46.381800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6beee-acf6-4eb7-9695-387899660bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:46.382457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6beee-acf6-4eb7-9695-387899660bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:46.383033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6beee-acf6-4eb7-9695-387899660bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:46.383033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6beee-acf6-4eb7-9695-387899660bf3 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:46.383804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6beee-acf6-4eb7-9695-387899660bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:46.384102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6beee-acf6-4eb7-9695-387899660bf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:46.385509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6beee-acf6-4eb7-9695-387899660bf3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:46.408383 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 601/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Sep 3 01:12:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:46.414899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e746-e420-49f3-89ac-a637d124a95e None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:46.545757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e746-e420-49f3-89ac-a637d124a95e None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:46.593447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d4fc-19b4-42e7-b0c9-185da9b0fd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:46.594070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d4fc-19b4-42e7-b0c9-185da9b0fd73 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:46.594354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d4fc-19b4-42e7-b0c9-185da9b0fd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:46.594831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d4fc-19b4-42e7-b0c9-185da9b0fd73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:46.632534 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:46.676604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3d4fc-19b4-42e7-b0c9-185da9b0fd73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:46.679420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3d4fc-19b4-42e7-b0c9-185da9b0fd73 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:46.810645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 613/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:12:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:12:46.817182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6beee-acf6-4eb7-9695-387899660bf3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:46.844714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:46.936512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6beee-acf6-4eb7-9695-387899660bf3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:46.977344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfb854-cf3c-4e37-a715-e31f87174651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:46.979945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfb854-cf3c-4e37-a715-e31f87174651 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:46.979945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfb854-cf3c-4e37-a715-e31f87174651 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:46.979945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfb854-cf3c-4e37-a715-e31f87174651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:46.991317 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfb854-cf3c-4e37-a715-e31f87174651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:46.992918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfb854-cf3c-4e37-a715-e31f87174651 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-05cfb854-cf3c-4e37-a715-e31f87174651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:12:47.008394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:47.009479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:12:47.017007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:12:47.017007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:47.017007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:12:47.017007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 602/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:12:47.017239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d4fc-19b4-42e7-b0c9-185da9b0fd73 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:47.091727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:47.145779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d4fc-19b4-42e7-b0c9-185da9b0fd73 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:47.197793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04d5f-2e86-4aff-bccf-0c924afc9e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:47.198387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04d5f-2e86-4aff-bccf-0c924afc9e0b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:47.198662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04d5f-2e86-4aff-bccf-0c924afc9e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:47.198942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04d5f-2e86-4aff-bccf-0c924afc9e0b None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:47.199777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d04d5f-2e86-4aff-bccf-0c924afc9e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:47.200092 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d04d5f-2e86-4aff-bccf-0c924afc9e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:47.201520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d04d5f-2e86-4aff-bccf-0c924afc9e0b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:47.215863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 614/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:12:47.221850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfb854-cf3c-4e37-a715-e31f87174651 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:47.302428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:47.343274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfb854-cf3c-4e37-a715-e31f87174651 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:47.382162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf173-9b5b-48da-aac3-c85f1c9dc493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:47.383002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf173-9b5b-48da-aac3-c85f1c9dc493 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:47.383386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf173-9b5b-48da-aac3-c85f1c9dc493 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:47.383747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf173-9b5b-48da-aac3-c85f1c9dc493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:47.391281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf173-9b5b-48da-aac3-c85f1c9dc493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:47.392744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf173-9b5b-48da-aac3-c85f1c9dc493 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-58adf173-9b5b-48da-aac3-c85f1c9dc493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:12:47.405002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:47.405956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:47.407017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:12:47.407017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:12:47.407017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:12:47.407017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:12:47.407017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:12:47.407017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:12:47.407017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:12:47.407017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:12:47.407017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 603/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:47.412217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04d5f-2e86-4aff-bccf-0c924afc9e0b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:47.521014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04d5f-2e86-4aff-bccf-0c924afc9e0b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:47.546807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:47.560857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6033-3e61-492c-9571-4141642f1000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:47.561503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6033-3e61-492c-9571-4141642f1000 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:47.561874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6033-3e61-492c-9571-4141642f1000 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:47.562163 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6033-3e61-492c-9571-4141642f1000 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:47.562865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6033-3e61-492c-9571-4141642f1000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:47.563170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6033-3e61-492c-9571-4141642f1000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:47.564649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6033-3e61-492c-9571-4141642f1000 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:47.585142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 615/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:47.586851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf173-9b5b-48da-aac3-c85f1c9dc493 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:47.707046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf173-9b5b-48da-aac3-c85f1c9dc493 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:47.744785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:47.753459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1faa0-7232-4240-8a9f-91e15b921993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:47.754152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1faa0-7232-4240-8a9f-91e15b921993 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:47.754523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1faa0-7232-4240-8a9f-91e15b921993 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:47.754820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1faa0-7232-4240-8a9f-91e15b921993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:47.755716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1faa0-7232-4240-8a9f-91e15b921993 None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=bac171ccd62b4c268e79a318478414ac) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:47.756032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1faa0-7232-4240-8a9f-91e15b921993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:47.757467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1faa0-7232-4240-8a9f-91e15b921993 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:47.765208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 604/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:12:47 2022] GET /identity/v3/role_assignments?user.id=bac171ccd62b4c268e79a318478414ac&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:49.674753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d84d0-3512-4da3-befa-71f495671e92 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:49.675352 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d84d0-3512-4da3-befa-71f495671e92 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:49.675352 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d84d0-3512-4da3-befa-71f495671e92 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:49.676669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 616/1220] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:12:49.681832 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896bb41-47e7-4015-82d9-bdee585cd1b7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:49.682245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896bb41-47e7-4015-82d9-bdee585cd1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:49.682386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896bb41-47e7-4015-82d9-bdee585cd1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:49.701002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1896bb41-47e7-4015-82d9-bdee585cd1b7 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:12:49.702199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1896bb41-47e7-4015-82d9-bdee585cd1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:12:49.771586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 605/1221] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:12:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:12:50.036073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d84d0-3512-4da3-befa-71f495671e92 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:50.145993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d84d0-3512-4da3-befa-71f495671e92 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:50.183787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dfad7-4bf3-43b1-8ed2-a8d8c55e11d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:50.184447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dfad7-4bf3-43b1-8ed2-a8d8c55e11d9 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:50.184729 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dfad7-4bf3-43b1-8ed2-a8d8c55e11d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:50.184999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dfad7-4bf3-43b1-8ed2-a8d8c55e11d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:50.196173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dfad7-4bf3-43b1-8ed2-a8d8c55e11d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-287dfad7-4bf3-43b1-8ed2-a8d8c55e11d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:12:50.201681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:50.202836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:12:50.208416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 617/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:12:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:50.209190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896bb41-47e7-4015-82d9-bdee585cd1b7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:50.317407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896bb41-47e7-4015-82d9-bdee585cd1b7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:50.341913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:50.353907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80421164-70cb-4207-aac4-6ab84f31e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:50.354529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80421164-70cb-4207-aac4-6ab84f31e21b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:50.354808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80421164-70cb-4207-aac4-6ab84f31e21b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:50.355104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80421164-70cb-4207-aac4-6ab84f31e21b None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:50.355940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80421164-70cb-4207-aac4-6ab84f31e21b None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:50.356243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80421164-70cb-4207-aac4-6ab84f31e21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:50.357598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80421164-70cb-4207-aac4-6ab84f31e21b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:50.367379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 606/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:12:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:50.373724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dfad7-4bf3-43b1-8ed2-a8d8c55e11d9 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:50.421174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:50.478732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dfad7-4bf3-43b1-8ed2-a8d8c55e11d9 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:50.515096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341f144-a755-4c0d-bcc6-7045fbe5282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:50.515758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341f144-a755-4c0d-bcc6-7045fbe5282f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:50.516032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341f144-a755-4c0d-bcc6-7045fbe5282f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:50.516300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341f144-a755-4c0d-bcc6-7045fbe5282f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:50.526336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341f144-a755-4c0d-bcc6-7045fbe5282f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:50.527857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341f144-a755-4c0d-bcc6-7045fbe5282f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-5341f144-a755-4c0d-bcc6-7045fbe5282f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:12:50.542036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:50.543576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:12:50.544612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:12:50.544612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:50.544612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:12:50.544612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 618/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:50.549700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80421164-70cb-4207-aac4-6ab84f31e21b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:50.669460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80421164-70cb-4207-aac4-6ab84f31e21b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:50.705563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a9263-1dd5-4ab3-9895-f38a46253d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:50.706231 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a9263-1dd5-4ab3-9895-f38a46253d11 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:50.706435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a9263-1dd5-4ab3-9895-f38a46253d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:50.706701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a9263-1dd5-4ab3-9895-f38a46253d11 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:50.707498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a9263-1dd5-4ab3-9895-f38a46253d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:50.707793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a9263-1dd5-4ab3-9895-f38a46253d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:50.709160 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a9263-1dd5-4ab3-9895-f38a46253d11 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:50.721173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 607/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:50.727621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341f144-a755-4c0d-bcc6-7045fbe5282f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:50.822620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:50.830410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341f144-a755-4c0d-bcc6-7045fbe5282f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:50.868806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1453e-43f9-4e1e-a308-a5febd387d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:50.869564 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1453e-43f9-4e1e-a308-a5febd387d08 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:50.869925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1453e-43f9-4e1e-a308-a5febd387d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:50.870195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1453e-43f9-4e1e-a308-a5febd387d08 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:50.878929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1453e-43f9-4e1e-a308-a5febd387d08 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:50.880432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1453e-43f9-4e1e-a308-a5febd387d08 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-f6c1453e-43f9-4e1e-a308-a5febd387d08 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:12:50.892140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:50.893371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:12:50.894335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 619/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:50.899470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a9263-1dd5-4ab3-9895-f38a46253d11 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:50.949996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:51.006820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a9263-1dd5-4ab3-9895-f38a46253d11 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:51.039792 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f90fd5-af4a-4a27-a9bb-c9b5a6380812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:51.040401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90fd5-af4a-4a27-a9bb-c9b5a6380812 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:51.040675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90fd5-af4a-4a27-a9bb-c9b5a6380812 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:51.040943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90fd5-af4a-4a27-a9bb-c9b5a6380812 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:51.041666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f90fd5-af4a-4a27-a9bb-c9b5a6380812 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:51.041966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f90fd5-af4a-4a27-a9bb-c9b5a6380812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:51.043639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f90fd5-af4a-4a27-a9bb-c9b5a6380812 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:51.061315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 608/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Sep 3 01:12:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:51.069195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1453e-43f9-4e1e-a308-a5febd387d08 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:51.180978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1453e-43f9-4e1e-a308-a5febd387d08 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:51.218330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37e119-3822-4c37-9878-4125d3b72941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:51.218872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37e119-3822-4c37-9878-4125d3b72941 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:51.219237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37e119-3822-4c37-9878-4125d3b72941 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:51.219590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37e119-3822-4c37-9878-4125d3b72941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:51.231207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37e119-3822-4c37-9878-4125d3b72941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:51.232894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37e119-3822-4c37-9878-4125d3b72941 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-ba37e119-3822-4c37-9878-4125d3b72941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:12:51.247718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:51.248735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:12:51.249721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:12:51.249721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:51.249721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:12:51.249721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 620/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:51.255051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f90fd5-af4a-4a27-a9bb-c9b5a6380812 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:51.371077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f90fd5-af4a-4a27-a9bb-c9b5a6380812 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:51.373756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:51.409061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc287c39-accc-481e-8c62-c480645d35ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:51.409671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc287c39-accc-481e-8c62-c480645d35ce None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:51.409913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc287c39-accc-481e-8c62-c480645d35ce None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:51.410174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc287c39-accc-481e-8c62-c480645d35ce None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:51.410879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc287c39-accc-481e-8c62-c480645d35ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:51.411198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc287c39-accc-481e-8c62-c480645d35ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:51.412668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc287c39-accc-481e-8c62-c480645d35ce None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:51.426437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 609/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:51.432516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37e119-3822-4c37-9878-4125d3b72941 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:51.443328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:51.545732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37e119-3822-4c37-9878-4125d3b72941 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:51.586399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8e61b-c64c-4801-a8f2-309f63fe853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:51.587098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8e61b-c64c-4801-a8f2-309f63fe853d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:51.587411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8e61b-c64c-4801-a8f2-309f63fe853d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:51.587712 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8e61b-c64c-4801-a8f2-309f63fe853d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:51.596866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8e61b-c64c-4801-a8f2-309f63fe853d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:51.598682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8e61b-c64c-4801-a8f2-309f63fe853d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-cfb8e61b-c64c-4801-a8f2-309f63fe853d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:12:51.618165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:51.619339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:51.620487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:12:51.620487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:12:51.620487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:12:51.620487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:12:51.620487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:12:51.620487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:12:51.620487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:12:51.620487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:12:51.620487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 621/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:51.626742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc287c39-accc-481e-8c62-c480645d35ce None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:51.741000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc287c39-accc-481e-8c62-c480645d35ce None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:51.776020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dd511-69d7-4e84-ad48-6ddb10ec4174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:51.776636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd511-69d7-4e84-ad48-6ddb10ec4174 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:51.776916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd511-69d7-4e84-ad48-6ddb10ec4174 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:51.777349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd511-69d7-4e84-ad48-6ddb10ec4174 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:51.778290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dd511-69d7-4e84-ad48-6ddb10ec4174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:51.778593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dd511-69d7-4e84-ad48-6ddb10ec4174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:51.780063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dd511-69d7-4e84-ad48-6ddb10ec4174 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:51.792085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 610/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:12:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:51.798958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8e61b-c64c-4801-a8f2-309f63fe853d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:51.877685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:51.919745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8e61b-c64c-4801-a8f2-309f63fe853d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:51.958686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d345b-5a17-4b0e-94c0-08e7d5bd87da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:51.959453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d345b-5a17-4b0e-94c0-08e7d5bd87da None admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:51.959735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d345b-5a17-4b0e-94c0-08e7d5bd87da None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:51.960008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d345b-5a17-4b0e-94c0-08e7d5bd87da None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/bac171ccd62b4c268e79a318478414ac/roles/76b5fcb0eb664fb2b2812e427e7f9390` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:51.978239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d345b-5a17-4b0e-94c0-08e7d5bd87da None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=bac171ccd62b4c268e79a318478414ac, role_id=76b5fcb0eb664fb2b2812e427e7f9390)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:51.979896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d345b-5a17-4b0e-94c0-08e7d5bd87da None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:51.996021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 622/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:12:51 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/bac171ccd62b4c268e79a318478414ac/roles/76b5fcb0eb664fb2b2812e427e7f9390 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:12:54.076010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5549-3aac-4deb-9f27-ca7b7dee0724 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:54.076564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5549-3aac-4deb-9f27-ca7b7dee0724 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:54.076564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5549-3aac-4deb-9f27-ca7b7dee0724 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:54.078311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 611/1233] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:12:54.084698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbfbf2-0870-415c-ac7d-0ff5d8d80958 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:54.084698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbfbf2-0870-415c-ac7d-0ff5d8d80958 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:54.085403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbfbf2-0870-415c-ac7d-0ff5d8d80958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:54.107018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5cbbfbf2-0870-415c-ac7d-0ff5d8d80958 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:12:54.108379 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5cbbfbf2-0870-415c-ac7d-0ff5d8d80958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:12:54.183811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 623/1234] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:12:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:12:54.458230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd5549-3aac-4deb-9f27-ca7b7dee0724 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:54.484490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:54.564454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd5549-3aac-4deb-9f27-ca7b7dee0724 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:54.608688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7fff6-9a26-4017-b04e-cab21d5cc79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:54.609516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7fff6-9a26-4017-b04e-cab21d5cc79e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:54.609799 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7fff6-9a26-4017-b04e-cab21d5cc79e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:54.610068 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7fff6-9a26-4017-b04e-cab21d5cc79e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:54.621864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7fff6-9a26-4017-b04e-cab21d5cc79e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-42d7fff6-9a26-4017-b04e-cab21d5cc79e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:12:54.629208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:54.630506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:12:54.636203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 612/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Sep 3 01:12:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:54.637753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbfbf2-0870-415c-ac7d-0ff5d8d80958 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:54.685341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:54.742214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbfbf2-0870-415c-ac7d-0ff5d8d80958 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:54.776598 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f291-3c05-4842-8e63-c4d0f9db6644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:54.777279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f291-3c05-4842-8e63-c4d0f9db6644 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:54.777551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f291-3c05-4842-8e63-c4d0f9db6644 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:54.777818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f291-3c05-4842-8e63-c4d0f9db6644 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:54.778599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f291-3c05-4842-8e63-c4d0f9db6644 None admin] RBAC: Adding query filter params (name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:54.778904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f291-3c05-4842-8e63-c4d0f9db6644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:54.780316 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f291-3c05-4842-8e63-c4d0f9db6644 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:54.788601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 624/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Sep 3 01:12:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:54.794668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7fff6-9a26-4017-b04e-cab21d5cc79e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:54.880480 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:54.896636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7fff6-9a26-4017-b04e-cab21d5cc79e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:54.934424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9af34-5092-44bf-8311-171401c7f9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:54.935047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9af34-5092-44bf-8311-171401c7f9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:54.935354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9af34-5092-44bf-8311-171401c7f9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:54.935622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9af34-5092-44bf-8311-171401c7f9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:54.945877 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9af34-5092-44bf-8311-171401c7f9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:54.947346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9af34-5092-44bf-8311-171401c7f9b4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7cc9af34-5092-44bf-8311-171401c7f9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:12:54.963382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:54.964750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:12:54.965764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:12:54.965764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:54.965764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:12:54.965764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 613/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:54.971495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f291-3c05-4842-8e63-c4d0f9db6644 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:55.076412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f291-3c05-4842-8e63-c4d0f9db6644 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:55.085934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:55.112170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7da7a-dc8a-40db-8bae-78c655b8c724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:55.113835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7da7a-dc8a-40db-8bae-78c655b8c724 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:55.114164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7da7a-dc8a-40db-8bae-78c655b8c724 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:55.114465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7da7a-dc8a-40db-8bae-78c655b8c724 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:55.115112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7da7a-dc8a-40db-8bae-78c655b8c724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:55.115416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7da7a-dc8a-40db-8bae-78c655b8c724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:55.116802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7da7a-dc8a-40db-8bae-78c655b8c724 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:55.130194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 625/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:55.136683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9af34-5092-44bf-8311-171401c7f9b4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:55.251006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9af34-5092-44bf-8311-171401c7f9b4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:55.288562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99276285-219c-4363-9a7d-32b85f9efc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:55.289204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99276285-219c-4363-9a7d-32b85f9efc47 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:55.289486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99276285-219c-4363-9a7d-32b85f9efc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:55.289776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99276285-219c-4363-9a7d-32b85f9efc47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:55.293743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:55.299408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99276285-219c-4363-9a7d-32b85f9efc47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:55.301197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99276285-219c-4363-9a7d-32b85f9efc47 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-99276285-219c-4363-9a7d-32b85f9efc47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:12:55.313542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:55.314722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:12:55.315883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 614/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:12:55.321224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7da7a-dc8a-40db-8bae-78c655b8c724 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:55.423367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7da7a-dc8a-40db-8bae-78c655b8c724 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:55.458190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c329c03-17e2-41f0-9224-f73256814390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:55.458838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c329c03-17e2-41f0-9224-f73256814390 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:55.459122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c329c03-17e2-41f0-9224-f73256814390 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:55.459441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c329c03-17e2-41f0-9224-f73256814390 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:55.460233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c329c03-17e2-41f0-9224-f73256814390 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:55.460613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c329c03-17e2-41f0-9224-f73256814390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:55.462134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c329c03-17e2-41f0-9224-f73256814390 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:55.482055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 626/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Sep 3 01:12:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:55.488668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99276285-219c-4363-9a7d-32b85f9efc47 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:55.606346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99276285-219c-4363-9a7d-32b85f9efc47 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:55.645610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd902f-639a-4aa7-b75e-b5c716ed2242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:55.646308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd902f-639a-4aa7-b75e-b5c716ed2242 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:55.646590 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd902f-639a-4aa7-b75e-b5c716ed2242 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:55.646894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd902f-639a-4aa7-b75e-b5c716ed2242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:55.712164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:55.719652 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd902f-639a-4aa7-b75e-b5c716ed2242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:55.721497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd902f-639a-4aa7-b75e-b5c716ed2242 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:55.824985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 615/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:12:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:12:55.831065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c329c03-17e2-41f0-9224-f73256814390 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:55.859872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:55.935982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c329c03-17e2-41f0-9224-f73256814390 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:55.971530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2440aa-48f4-4dae-8d71-17b322932a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:55.972143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2440aa-48f4-4dae-8d71-17b322932a9d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:55.972459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2440aa-48f4-4dae-8d71-17b322932a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:55.972762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2440aa-48f4-4dae-8d71-17b322932a9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:55.984285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2440aa-48f4-4dae-8d71-17b322932a9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:55.985933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2440aa-48f4-4dae-8d71-17b322932a9d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-fb2440aa-48f4-4dae-8d71-17b322932a9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:12:56.001790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:56.002893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:12:56.003890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:12:56.003890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:56.003890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:12:56.003890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 627/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:12:56.009466 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd902f-639a-4aa7-b75e-b5c716ed2242 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:56.118914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:56.125651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd902f-639a-4aa7-b75e-b5c716ed2242 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:56.162681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0eb9ff-1623-4e6e-84e9-87dfc1303b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:56.163462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eb9ff-1623-4e6e-84e9-87dfc1303b31 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:56.163618 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eb9ff-1623-4e6e-84e9-87dfc1303b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:56.163885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eb9ff-1623-4e6e-84e9-87dfc1303b31 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:56.164525 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0eb9ff-1623-4e6e-84e9-87dfc1303b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:56.164827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0eb9ff-1623-4e6e-84e9-87dfc1303b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:56.166884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0eb9ff-1623-4e6e-84e9-87dfc1303b31 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:56.178748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 616/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:56.184835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2440aa-48f4-4dae-8d71-17b322932a9d None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:56.271690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:56.298826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2440aa-48f4-4dae-8d71-17b322932a9d None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:56.336357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6fc2-b43a-4783-b24a-fa4c94ae9902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:56.336994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6fc2-b43a-4783-b24a-fa4c94ae9902 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:56.337241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6fc2-b43a-4783-b24a-fa4c94ae9902 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:56.337536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6fc2-b43a-4783-b24a-fa4c94ae9902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:56.345950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec6fc2-b43a-4783-b24a-fa4c94ae9902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:56.347706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec6fc2-b43a-4783-b24a-fa4c94ae9902 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-e0ec6fc2-b43a-4783-b24a-fa4c94ae9902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:12:56.360220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:56.361164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:56.362334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:12:56.362334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:12:56.362334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:12:56.362334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:12:56.362334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:12:56.362334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:12:56.362334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:12:56.362334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:12:56.362334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 628/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:56.367692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0eb9ff-1623-4e6e-84e9-87dfc1303b31 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:56.477105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0eb9ff-1623-4e6e-84e9-87dfc1303b31 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:56.515836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6a90f-4439-4688-bfec-a13f137ec848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:56.516458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a90f-4439-4688-bfec-a13f137ec848 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:56.516808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a90f-4439-4688-bfec-a13f137ec848 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:56.517092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a90f-4439-4688-bfec-a13f137ec848 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:56.517820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6a90f-4439-4688-bfec-a13f137ec848 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:56.518116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6a90f-4439-4688-bfec-a13f137ec848 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:56.519591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6a90f-4439-4688-bfec-a13f137ec848 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:56.534590 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 617/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:56.540566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6fc2-b43a-4783-b24a-fa4c94ae9902 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:56.654797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6fc2-b43a-4783-b24a-fa4c94ae9902 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:56.689436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14428a95-dcf2-4315-9091-b87fbb962d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:56.690041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14428a95-dcf2-4315-9091-b87fbb962d6d None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:56.690446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14428a95-dcf2-4315-9091-b87fbb962d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:56.690589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14428a95-dcf2-4315-9091-b87fbb962d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:56.691348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14428a95-dcf2-4315-9091-b87fbb962d6d None admin] RBAC: Adding query filter params (role.id=76b5fcb0eb664fb2b2812e427e7f9390, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=bac171ccd62b4c268e79a318478414ac) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:56.691658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14428a95-dcf2-4315-9091-b87fbb962d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:56.693096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14428a95-dcf2-4315-9091-b87fbb962d6d None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:56.699702 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 629/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:12:56 2022] GET /identity/v3/role_assignments?user.id=bac171ccd62b4c268e79a318478414ac&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=76b5fcb0eb664fb2b2812e427e7f9390 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:58.821567 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79b3e5-529c-412f-9d6f-492a008de277 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:58.822272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79b3e5-529c-412f-9d6f-492a008de277 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:58.822272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79b3e5-529c-412f-9d6f-492a008de277 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:58.823609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 618/1247] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:12:58.829581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf9a6e-ea20-4d03-a525-e32b512a7b67 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:58.830184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf9a6e-ea20-4d03-a525-e32b512a7b67 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:58.830184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf9a6e-ea20-4d03-a525-e32b512a7b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:58.837220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:58.851807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-92bf9a6e-ea20-4d03-a525-e32b512a7b67 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:12:58.853015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-92bf9a6e-ea20-4d03-a525-e32b512a7b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:12:58.932389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 630/1248] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:12:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:12:59.231514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79b3e5-529c-412f-9d6f-492a008de277 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:59.252350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:59.348658 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79b3e5-529c-412f-9d6f-492a008de277 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:59.386712 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22793ae-bb20-46bf-80a5-453f196a1563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:59.387305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22793ae-bb20-46bf-80a5-453f196a1563 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:59.387585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22793ae-bb20-46bf-80a5-453f196a1563 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:59.387916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22793ae-bb20-46bf-80a5-453f196a1563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:59.401670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22793ae-bb20-46bf-80a5-453f196a1563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b22793ae-bb20-46bf-80a5-453f196a1563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:12:59.406820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:59.408033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:12:59.408904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 619/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:12:59.414646 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf9a6e-ea20-4d03-a525-e32b512a7b67 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:59.525669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf9a6e-ea20-4d03-a525-e32b512a7b67 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:59.560563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:59.563440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c8e8d-ebd9-41fd-b1a0-04e4eeef42a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:59.564072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8e8d-ebd9-41fd-b1a0-04e4eeef42a8 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:59.564326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8e8d-ebd9-41fd-b1a0-04e4eeef42a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:59.564602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8e8d-ebd9-41fd-b1a0-04e4eeef42a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:59.565320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c8e8d-ebd9-41fd-b1a0-04e4eeef42a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:59.565834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c8e8d-ebd9-41fd-b1a0-04e4eeef42a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:59.567616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c8e8d-ebd9-41fd-b1a0-04e4eeef42a8 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:59.577534 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 631/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:59.584219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22793ae-bb20-46bf-80a5-453f196a1563 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:59.682334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:12:59.709486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22793ae-bb20-46bf-80a5-453f196a1563 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:59.748622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afb3b8-9d82-486f-bae6-2c104d94fa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:59.749423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afb3b8-9d82-486f-bae6-2c104d94fa8d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:59.749702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afb3b8-9d82-486f-bae6-2c104d94fa8d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:59.749970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afb3b8-9d82-486f-bae6-2c104d94fa8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:59.762968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afb3b8-9d82-486f-bae6-2c104d94fa8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:59.762968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afb3b8-9d82-486f-bae6-2c104d94fa8d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-85afb3b8-9d82-486f-bae6-2c104d94fa8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:12:59.779722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:12:59.780971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:12:59.782199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:12:59.782199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:12:59.782199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:12:59.782199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 620/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:12:59.786859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c8e8d-ebd9-41fd-b1a0-04e4eeef42a8 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:12:59.904336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c8e8d-ebd9-41fd-b1a0-04e4eeef42a8 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:12:59.941344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c997d-3d7c-4ec7-8a5b-fc10bafa2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:12:59.941950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c997d-3d7c-4ec7-8a5b-fc10bafa2421 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:12:59.942225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c997d-3d7c-4ec7-8a5b-fc10bafa2421 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:12:59.942493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c997d-3d7c-4ec7-8a5b-fc10bafa2421 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:12:59.943127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c997d-3d7c-4ec7-8a5b-fc10bafa2421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:12:59.943451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c997d-3d7c-4ec7-8a5b-fc10bafa2421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:12:59.944983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c997d-3d7c-4ec7-8a5b-fc10bafa2421 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:12:59.958325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 632/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:12:59.965259 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afb3b8-9d82-486f-bae6-2c104d94fa8d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:00.080066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afb3b8-9d82-486f-bae6-2c104d94fa8d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:00.108871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:00.117022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84105916-26fa-4164-adc3-40459365e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:00.117660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84105916-26fa-4164-adc3-40459365e1dd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:00.117938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84105916-26fa-4164-adc3-40459365e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:00.118232 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84105916-26fa-4164-adc3-40459365e1dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:00.127173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84105916-26fa-4164-adc3-40459365e1dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:00.128717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84105916-26fa-4164-adc3-40459365e1dd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-84105916-26fa-4164-adc3-40459365e1dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:13:00.140406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:00.141611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:13:00.142661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 621/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:12:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:13:00.148461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c997d-3d7c-4ec7-8a5b-fc10bafa2421 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:00.213602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:00.265436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c997d-3d7c-4ec7-8a5b-fc10bafa2421 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:00.303860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768f58-4679-456a-8f46-d0ad1c7447c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:00.304471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768f58-4679-456a-8f46-d0ad1c7447c1 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:00.304754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768f58-4679-456a-8f46-d0ad1c7447c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:00.305026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768f58-4679-456a-8f46-d0ad1c7447c1 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:00.305998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62768f58-4679-456a-8f46-d0ad1c7447c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:00.306349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62768f58-4679-456a-8f46-d0ad1c7447c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:00.308698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62768f58-4679-456a-8f46-d0ad1c7447c1 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:00.327614 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 633/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Sep 3 01:13:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:00.333715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84105916-26fa-4164-adc3-40459365e1dd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:00.443937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84105916-26fa-4164-adc3-40459365e1dd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:00.481168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb5563-8ab4-47c7-8489-018083ad575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:00.481787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb5563-8ab4-47c7-8489-018083ad575b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:00.482114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb5563-8ab4-47c7-8489-018083ad575b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:00.482377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb5563-8ab4-47c7-8489-018083ad575b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:00.540492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:00.554011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb5563-8ab4-47c7-8489-018083ad575b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:00.555511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb5563-8ab4-47c7-8489-018083ad575b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:00.686387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 622/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:13:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:13:00.692380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768f58-4679-456a-8f46-d0ad1c7447c1 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:00.799496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768f58-4679-456a-8f46-d0ad1c7447c1 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:00.815100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:00.839570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ff176-c81d-44be-a5eb-e792026eb524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:00.840253 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ff176-c81d-44be-a5eb-e792026eb524 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:00.840537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ff176-c81d-44be-a5eb-e792026eb524 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:00.840790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ff176-c81d-44be-a5eb-e792026eb524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:00.852055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ff176-c81d-44be-a5eb-e792026eb524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:00.853760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ff176-c81d-44be-a5eb-e792026eb524 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-aa5ff176-c81d-44be-a5eb-e792026eb524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:13:00.869918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:00.871218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:13:00.872198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:13:00.872198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:13:00.872198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:00.872198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 634/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:00.877261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb5563-8ab4-47c7-8489-018083ad575b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:00.971241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:00.984120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb5563-8ab4-47c7-8489-018083ad575b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:01.019224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8985c0a-f667-43b5-9449-f401f986d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:01.019949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8985c0a-f667-43b5-9449-f401f986d07d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:01.020260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8985c0a-f667-43b5-9449-f401f986d07d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:01.020563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8985c0a-f667-43b5-9449-f401f986d07d None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:01.021279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8985c0a-f667-43b5-9449-f401f986d07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:01.021575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8985c0a-f667-43b5-9449-f401f986d07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:01.023037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8985c0a-f667-43b5-9449-f401f986d07d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:01.036282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 623/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:01.042076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ff176-c81d-44be-a5eb-e792026eb524 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:01.149585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ff176-c81d-44be-a5eb-e792026eb524 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:01.186956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c247d-865b-47d8-be48-d0638eae02f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:01.187622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c247d-865b-47d8-be48-d0638eae02f1 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:01.187902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c247d-865b-47d8-be48-d0638eae02f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:01.188203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c247d-865b-47d8-be48-d0638eae02f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:01.197046 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c247d-865b-47d8-be48-d0638eae02f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:01.198572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c247d-865b-47d8-be48-d0638eae02f1 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-015c247d-865b-47d8-be48-d0638eae02f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:13:01.210076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:01.211094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:01.212032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:13:01.212032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:13:01.212032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:13:01.212032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:13:01.212032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:13:01.212032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:13:01.212032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:13:01.212032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:01.212032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 635/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:01.218308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8985c0a-f667-43b5-9449-f401f986d07d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:01.324353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8985c0a-f667-43b5-9449-f401f986d07d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:01.361824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19022ccd-545e-4f98-9071-33b5e10563cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:01.362445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022ccd-545e-4f98-9071-33b5e10563cf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:01.362717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022ccd-545e-4f98-9071-33b5e10563cf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:01.362985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022ccd-545e-4f98-9071-33b5e10563cf None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:01.363721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022ccd-545e-4f98-9071-33b5e10563cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:01.364021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022ccd-545e-4f98-9071-33b5e10563cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:01.365451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022ccd-545e-4f98-9071-33b5e10563cf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:01.378270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 624/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:01.384759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c247d-865b-47d8-be48-d0638eae02f1 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:01.410862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:01.485519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c247d-865b-47d8-be48-d0638eae02f1 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:01.519679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40acba-f62a-4651-98d6-5d5504ca5cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:01.520332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40acba-f62a-4651-98d6-5d5504ca5cec None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:01.520635 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40acba-f62a-4651-98d6-5d5504ca5cec None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:01.520938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40acba-f62a-4651-98d6-5d5504ca5cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:01.521846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40acba-f62a-4651-98d6-5d5504ca5cec None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=bac171ccd62b4c268e79a318478414ac) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:01.522188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40acba-f62a-4651-98d6-5d5504ca5cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:01.523838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40acba-f62a-4651-98d6-5d5504ca5cec None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:01.547285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 636/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:13:01 2022] GET /identity/v3/role_assignments?user.id=bac171ccd62b4c268e79a318478414ac&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:03.395177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828d2c6-16a1-4936-96c0-068341f94468 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:03.395757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828d2c6-16a1-4936-96c0-068341f94468 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:03.395844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828d2c6-16a1-4936-96c0-068341f94468 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:03.397234 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 625/1261] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:13:03.403797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a04a39-5dad-4d0b-8828-ebd82009d95c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:03.404230 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a04a39-5dad-4d0b-8828-ebd82009d95c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:03.404320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a04a39-5dad-4d0b-8828-ebd82009d95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:03.427982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-46a04a39-5dad-4d0b-8828-ebd82009d95c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:13:03.429176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-46a04a39-5dad-4d0b-8828-ebd82009d95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:13:03.500954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 637/1262] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:13:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:13:03.779224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828d2c6-16a1-4936-96c0-068341f94468 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:03.791906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:03.888421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828d2c6-16a1-4936-96c0-068341f94468 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:03.924465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca20147-23ca-4ed7-b66f-b60154681706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:03.925085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca20147-23ca-4ed7-b66f-b60154681706 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:03.925363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca20147-23ca-4ed7-b66f-b60154681706 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:03.925631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca20147-23ca-4ed7-b66f-b60154681706 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:03.937078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca20147-23ca-4ed7-b66f-b60154681706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8ca20147-23ca-4ed7-b66f-b60154681706 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:13:03.941948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:03.943005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:13:03.943911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 626/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:03.949588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a04a39-5dad-4d0b-8828-ebd82009d95c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:03.968693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:04.056565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a04a39-5dad-4d0b-8828-ebd82009d95c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:04.090602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed385d2-d546-4c4c-8e84-ac1e11886c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:04.091193 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed385d2-d546-4c4c-8e84-ac1e11886c7e None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:04.091495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed385d2-d546-4c4c-8e84-ac1e11886c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:04.091764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed385d2-d546-4c4c-8e84-ac1e11886c7e None admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:04.092417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed385d2-d546-4c4c-8e84-ac1e11886c7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:04.092716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed385d2-d546-4c4c-8e84-ac1e11886c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:04.094075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed385d2-d546-4c4c-8e84-ac1e11886c7e None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:04.102439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 638/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:04.108633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca20147-23ca-4ed7-b66f-b60154681706 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:04.187875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:04.223931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca20147-23ca-4ed7-b66f-b60154681706 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:04.259182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b54a29-ac12-4737-a881-4e616723d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:04.259824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b54a29-ac12-4737-a881-4e616723d00b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:04.260097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b54a29-ac12-4737-a881-4e616723d00b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:04.260444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b54a29-ac12-4737-a881-4e616723d00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:04.270615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b54a29-ac12-4737-a881-4e616723d00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:04.272078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b54a29-ac12-4737-a881-4e616723d00b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-27b54a29-ac12-4737-a881-4e616723d00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:13:04.286605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:04.287698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:13:04.289192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:13:04.289192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:13:04.289192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:13:04.289192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 627/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:04.295275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed385d2-d546-4c4c-8e84-ac1e11886c7e None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:04.377160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:04.403953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed385d2-d546-4c4c-8e84-ac1e11886c7e None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:04.443143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2fb5b-5fc4-4f4b-bbf1-0e895610e4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:04.443759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2fb5b-5fc4-4f4b-bbf1-0e895610e4be None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:04.444040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2fb5b-5fc4-4f4b-bbf1-0e895610e4be None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:04.444306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2fb5b-5fc4-4f4b-bbf1-0e895610e4be None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:04.444939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2fb5b-5fc4-4f4b-bbf1-0e895610e4be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:04.445242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2fb5b-5fc4-4f4b-bbf1-0e895610e4be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:04.446604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2fb5b-5fc4-4f4b-bbf1-0e895610e4be None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:04.459532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 639/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:04.466904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b54a29-ac12-4737-a881-4e616723d00b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:04.572940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b54a29-ac12-4737-a881-4e616723d00b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:04.597000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:04.612899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7425002-6bba-4801-afdd-47d636e0133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:04.613546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7425002-6bba-4801-afdd-47d636e0133d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:04.613795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7425002-6bba-4801-afdd-47d636e0133d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:04.614061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7425002-6bba-4801-afdd-47d636e0133d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:04.622404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7425002-6bba-4801-afdd-47d636e0133d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:04.623861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7425002-6bba-4801-afdd-47d636e0133d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f7425002-6bba-4801-afdd-47d636e0133d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:13:04.635059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:04.636137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:13:04.637309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 628/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:13:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:04.642319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2fb5b-5fc4-4f4b-bbf1-0e895610e4be None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:04.747944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2fb5b-5fc4-4f4b-bbf1-0e895610e4be None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:04.783601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47476554-6f9c-45ba-b859-7d384d6dcb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:04.784187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47476554-6f9c-45ba-b859-7d384d6dcb20 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:04.784461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47476554-6f9c-45ba-b859-7d384d6dcb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:04.784735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47476554-6f9c-45ba-b859-7d384d6dcb20 None admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:04.785448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47476554-6f9c-45ba-b859-7d384d6dcb20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:04.785757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47476554-6f9c-45ba-b859-7d384d6dcb20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:04.787201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47476554-6f9c-45ba-b859-7d384d6dcb20 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:04.795955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:04.809569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 640/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Sep 3 01:13:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:04.816275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7425002-6bba-4801-afdd-47d636e0133d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:04.924328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7425002-6bba-4801-afdd-47d636e0133d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:04.958349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c99ec-bbd0-4fc6-aeaf-b608e4b1cc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:04.958948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c99ec-bbd0-4fc6-aeaf-b608e4b1cc01 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:04.959220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c99ec-bbd0-4fc6-aeaf-b608e4b1cc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:04.959518 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c99ec-bbd0-4fc6-aeaf-b608e4b1cc01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:04.970370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c99ec-bbd0-4fc6-aeaf-b608e4b1cc01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:04.971827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c99ec-bbd0-4fc6-aeaf-b608e4b1cc01 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ff3c99ec-bbd0-4fc6-aeaf-b608e4b1cc01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:13:04.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:04.987520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:13:04.988611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:13:04.988611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:13:04.988611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:13:04.988611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 629/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:04.993686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47476554-6f9c-45ba-b859-7d384d6dcb20 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:05.100131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47476554-6f9c-45ba-b859-7d384d6dcb20 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:05.142834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e887c00-9070-4eb9-aa31-d05f5bdf54cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:05.143809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e887c00-9070-4eb9-aa31-d05f5bdf54cc None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:05.144219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e887c00-9070-4eb9-aa31-d05f5bdf54cc None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:05.144653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e887c00-9070-4eb9-aa31-d05f5bdf54cc None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:05.145677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e887c00-9070-4eb9-aa31-d05f5bdf54cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:05.146148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e887c00-9070-4eb9-aa31-d05f5bdf54cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:05.148373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e887c00-9070-4eb9-aa31-d05f5bdf54cc None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:05.161185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 641/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:05.167308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c99ec-bbd0-4fc6-aeaf-b608e4b1cc01 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:05.203797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:05.285589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c99ec-bbd0-4fc6-aeaf-b608e4b1cc01 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:05.319484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a10bb4-5a13-4805-a39f-8ceb42b777e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:05.320100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10bb4-5a13-4805-a39f-8ceb42b777e0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:05.320370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10bb4-5a13-4805-a39f-8ceb42b777e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:05.320635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10bb4-5a13-4805-a39f-8ceb42b777e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:05.327450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a10bb4-5a13-4805-a39f-8ceb42b777e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:05.328872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a10bb4-5a13-4805-a39f-8ceb42b777e0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d4a10bb4-5a13-4805-a39f-8ceb42b777e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:13:05.340295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:05.341297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:05.342412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:13:05.342412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:13:05.342412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:13:05.342412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:13:05.342412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:13:05.342412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:13:05.342412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:13:05.342412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:13:05.342412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 630/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:13:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:05.348022 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e887c00-9070-4eb9-aa31-d05f5bdf54cc None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:05.408187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:05.452690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e887c00-9070-4eb9-aa31-d05f5bdf54cc None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:05.488534 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7da93-313d-4067-8e57-db5a9b820a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:05.489123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7da93-313d-4067-8e57-db5a9b820a75 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:05.489399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7da93-313d-4067-8e57-db5a9b820a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:05.489666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7da93-313d-4067-8e57-db5a9b820a75 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:05.490346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7da93-313d-4067-8e57-db5a9b820a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:05.490655 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7da93-313d-4067-8e57-db5a9b820a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:05.492121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7da93-313d-4067-8e57-db5a9b820a75 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:05.504908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 642/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:13:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:05.511580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a10bb4-5a13-4805-a39f-8ceb42b777e0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:05.625139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:05.636969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a10bb4-5a13-4805-a39f-8ceb42b777e0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:05.676980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffa5da-f80e-4505-8593-baf9dbc6706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:05.677632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffa5da-f80e-4505-8593-baf9dbc6706e None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:05.677912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffa5da-f80e-4505-8593-baf9dbc6706e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:05.678184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffa5da-f80e-4505-8593-baf9dbc6706e None admin] PATH_INFO: `/v3/projects/5153adb6d588454d851b81eaf2af1971/users/bac171ccd62b4c268e79a318478414ac/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:05.680140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffa5da-f80e-4505-8593-baf9dbc6706e None admin] RBAC: Authorizing `identity:create_grant(project_id=5153adb6d588454d851b81eaf2af1971, user_id=bac171ccd62b4c268e79a318478414ac, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:05.681572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffa5da-f80e-4505-8593-baf9dbc6706e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:05.700485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 631/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Sep 3 01:13:05 2022] PUT /identity/v3/projects/5153adb6d588454d851b81eaf2af1971/users/bac171ccd62b4c268e79a318478414ac/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:13:07.545481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d339a13-632a-4744-aa69-39548058c117 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:07.546000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d339a13-632a-4744-aa69-39548058c117 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:07.546000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d339a13-632a-4744-aa69-39548058c117 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:07.548026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 643/1274] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:13:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:13:07.555929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423238c0-b51f-436f-8b65-38fef32cca16 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:07.556372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423238c0-b51f-436f-8b65-38fef32cca16 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:07.556462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423238c0-b51f-436f-8b65-38fef32cca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:07.576374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-423238c0-b51f-436f-8b65-38fef32cca16 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:13:07.577745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-423238c0-b51f-436f-8b65-38fef32cca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:13:07.647652 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 632/1275] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:13:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:13:07.912420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d339a13-632a-4744-aa69-39548058c117 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:08.025708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d339a13-632a-4744-aa69-39548058c117 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:08.044591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:08.066815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54877419-573f-49d0-8da1-ef0e231da820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:08.067474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54877419-573f-49d0-8da1-ef0e231da820 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:08.067753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54877419-573f-49d0-8da1-ef0e231da820 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:08.068025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54877419-573f-49d0-8da1-ef0e231da820 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:08.078813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54877419-573f-49d0-8da1-ef0e231da820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-54877419-573f-49d0-8da1-ef0e231da820 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 01:13:08.083666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:08.084728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:08.085943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 644/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Sep 3 01:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:08.090957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423238c0-b51f-436f-8b65-38fef32cca16 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:08.185989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:08.212773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423238c0-b51f-436f-8b65-38fef32cca16 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:08.249567 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaaf4c-7974-405e-8f99-3c69dd95667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:08.250166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaaf4c-7974-405e-8f99-3c69dd95667e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:08.250434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaaf4c-7974-405e-8f99-3c69dd95667e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:08.250675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaaf4c-7974-405e-8f99-3c69dd95667e None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:08.251376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaaf4c-7974-405e-8f99-3c69dd95667e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:08.251655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaaf4c-7974-405e-8f99-3c69dd95667e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:08.253012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaaf4c-7974-405e-8f99-3c69dd95667e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:08.261246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 633/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Sep 3 01:13:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:08.269909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54877419-573f-49d0-8da1-ef0e231da820 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:08.378906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54877419-573f-49d0-8da1-ef0e231da820 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:08.414643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f45d18-8bd8-49fd-9f23-1f0c4e00be9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:08.415281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f45d18-8bd8-49fd-9f23-1f0c4e00be9a None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:08.415567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f45d18-8bd8-49fd-9f23-1f0c4e00be9a None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:08.415836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f45d18-8bd8-49fd-9f23-1f0c4e00be9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:08.426183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f45d18-8bd8-49fd-9f23-1f0c4e00be9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:08.427659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f45d18-8bd8-49fd-9f23-1f0c4e00be9a None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-12f45d18-8bd8-49fd-9f23-1f0c4e00be9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:13:08.446104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:08.447208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:13:08.448633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:13:08.448633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:13:08.448633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:08.448633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 645/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:13:08.453970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaaf4c-7974-405e-8f99-3c69dd95667e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:08.570472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaaf4c-7974-405e-8f99-3c69dd95667e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:08.613437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cba30-d5ea-44df-9710-d1a82c40a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:08.614400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cba30-d5ea-44df-9710-d1a82c40a641 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:08.614790 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cba30-d5ea-44df-9710-d1a82c40a641 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:08.615281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cba30-d5ea-44df-9710-d1a82c40a641 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:08.616196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cba30-d5ea-44df-9710-d1a82c40a641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:08.616681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cba30-d5ea-44df-9710-d1a82c40a641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:08.618754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cba30-d5ea-44df-9710-d1a82c40a641 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:08.632731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 634/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:08.638950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f45d18-8bd8-49fd-9f23-1f0c4e00be9a None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:08.671913 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:08.742773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f45d18-8bd8-49fd-9f23-1f0c4e00be9a None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:08.777748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dea01-dad9-4776-9ef5-abf993ca7cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:08.778348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dea01-dad9-4776-9ef5-abf993ca7cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:08.778622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dea01-dad9-4776-9ef5-abf993ca7cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:08.778885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dea01-dad9-4776-9ef5-abf993ca7cc6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:08.786895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dea01-dad9-4776-9ef5-abf993ca7cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:08.788363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dea01-dad9-4776-9ef5-abf993ca7cc6 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-059dea01-dad9-4776-9ef5-abf993ca7cc6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 01:13:08.799814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:08.800875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:08.802038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 646/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:13:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:13:08.807389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cba30-d5ea-44df-9710-d1a82c40a641 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:08.811289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:08.912430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cba30-d5ea-44df-9710-d1a82c40a641 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:08.958111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5a39b-3228-4a79-b94f-564377af52ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:08.959046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5a39b-3228-4a79-b94f-564377af52ab None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:08.959533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5a39b-3228-4a79-b94f-564377af52ab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:08.959962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5a39b-3228-4a79-b94f-564377af52ab None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:08.961123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5a39b-3228-4a79-b94f-564377af52ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:08.961613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5a39b-3228-4a79-b94f-564377af52ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:08.963753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5a39b-3228-4a79-b94f-564377af52ab None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:08.981697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 635/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Sep 3 01:13:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:08.991168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dea01-dad9-4776-9ef5-abf993ca7cc6 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:09.102880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:09.120211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dea01-dad9-4776-9ef5-abf993ca7cc6 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:09.158671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fbbd1-bd01-440b-9445-89bf163a7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:09.159293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fbbd1-bd01-440b-9445-89bf163a7a04 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:09.159581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fbbd1-bd01-440b-9445-89bf163a7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:09.159852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fbbd1-bd01-440b-9445-89bf163a7a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:09.231373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fbbd1-bd01-440b-9445-89bf163a7a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:09.232827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fbbd1-bd01-440b-9445-89bf163a7a04 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:09.328328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:09.339503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 647/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Sep 3 01:13:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 01:13:09.345719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5a39b-3228-4a79-b94f-564377af52ab None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:09.410822 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:09.457268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5a39b-3228-4a79-b94f-564377af52ab None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:09.495909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71d506-ef31-4643-84ef-37f46df331f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:09.496801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71d506-ef31-4643-84ef-37f46df331f1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:09.497169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71d506-ef31-4643-84ef-37f46df331f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:09.497521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71d506-ef31-4643-84ef-37f46df331f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:09.512854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71d506-ef31-4643-84ef-37f46df331f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:09.514290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71d506-ef31-4643-84ef-37f46df331f1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1c71d506-ef31-4643-84ef-37f46df331f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 01:13:09.529781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:09.530863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 01:13:09.531992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 01:13:09.531992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 01:13:09.531992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:13:09.531992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 636/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 01:13:09.539314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fbbd1-bd01-440b-9445-89bf163a7a04 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:09.645802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fbbd1-bd01-440b-9445-89bf163a7a04 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:09.682059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2d73-b39c-4132-9078-927611eece67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:09.682592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2d73-b39c-4132-9078-927611eece67 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:09.682868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2d73-b39c-4132-9078-927611eece67 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:09.683141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2d73-b39c-4132-9078-927611eece67 None admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:09.683808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a2d73-b39c-4132-9078-927611eece67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:09.684111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a2d73-b39c-4132-9078-927611eece67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:09.685486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a2d73-b39c-4132-9078-927611eece67 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:09.696698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 648/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Sep 3 01:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:09.703413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71d506-ef31-4643-84ef-37f46df331f1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:09.825568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71d506-ef31-4643-84ef-37f46df331f1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:09.839631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:09.862087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64bf80-c4c2-4677-a091-b934ead42e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:09.862716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64bf80-c4c2-4677-a091-b934ead42e1e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:09.862991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64bf80-c4c2-4677-a091-b934ead42e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:09.863287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64bf80-c4c2-4677-a091-b934ead42e1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:09.870424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64bf80-c4c2-4677-a091-b934ead42e1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:09.871896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64bf80-c4c2-4677-a091-b934ead42e1e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6f64bf80-c4c2-4677-a091-b934ead42e1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 01:13:09.884106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:09.885272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:09.886397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 01:13:09.886397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 01:13:09.886397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 01:13:09.886397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 01:13:09.886397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 01:13:09.886397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 01:13:09.886397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 01:13:09.886397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 03 01:13:09.886397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 637/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Sep 3 01:13:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:09.891558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2d73-b39c-4132-9078-927611eece67 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:09.945716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:10.003644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2d73-b39c-4132-9078-927611eece67 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:10.038903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637379c-201c-42d8-8e39-9c9172fc8096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:10.039526 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637379c-201c-42d8-8e39-9c9172fc8096 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:10.039801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637379c-201c-42d8-8e39-9c9172fc8096 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:10.040071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637379c-201c-42d8-8e39-9c9172fc8096 None admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:10.040730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637379c-201c-42d8-8e39-9c9172fc8096 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:10.041104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637379c-201c-42d8-8e39-9c9172fc8096 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:10.043034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637379c-201c-42d8-8e39-9c9172fc8096 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:10.054832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 649/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Sep 3 01:13:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:10.062017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64bf80-c4c2-4677-a091-b934ead42e1e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:10.172521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64bf80-c4c2-4677-a091-b934ead42e1e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:10.210071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41def2-5152-4c37-a7fc-049e382153ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:10.210609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41def2-5152-4c37-a7fc-049e382153ec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:10.210880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41def2-5152-4c37-a7fc-049e382153ec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:10.211156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41def2-5152-4c37-a7fc-049e382153ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:10.211913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41def2-5152-4c37-a7fc-049e382153ec None admin] RBAC: Adding query filter params (role.id=2e5b46d9b7824920afcbf5bdd34f3092, scope.project.id=5153adb6d588454d851b81eaf2af1971, user.id=bac171ccd62b4c268e79a318478414ac) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:10.212214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41def2-5152-4c37-a7fc-049e382153ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:10.213843 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41def2-5152-4c37-a7fc-049e382153ec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:10.219732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 638/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Sep 3 01:13:10 2022] GET /identity/v3/role_assignments?user.id=bac171ccd62b4c268e79a318478414ac&scope.project.id=5153adb6d588454d851b81eaf2af1971&role.id=2e5b46d9b7824920afcbf5bdd34f3092 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:12.172569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e192-40d3-49dd-9229-828eed0fd2cd None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:12.173156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e192-40d3-49dd-9229-828eed0fd2cd None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:12.173156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e192-40d3-49dd-9229-828eed0fd2cd None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:12.174469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 650/1288] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:13:12.180786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b5e37-53ae-4758-b688-62a8280ddc41 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:12.181484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b5e37-53ae-4758-b688-62a8280ddc41 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:12.181788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b5e37-53ae-4758-b688-62a8280ddc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:12.201080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-670b5e37-53ae-4758-b688-62a8280ddc41 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:13:12.202268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-670b5e37-53ae-4758-b688-62a8280ddc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:13:12.234855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:12.274332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 639/1289] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:13:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:13:12.539170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8e192-40d3-49dd-9229-828eed0fd2cd None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:12.669979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8e192-40d3-49dd-9229-828eed0fd2cd None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:12.680839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:12.710356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f761a7-b0ab-4263-8e70-605fc0c2829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:12.710986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f761a7-b0ab-4263-8e70-605fc0c2829f None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:12.711285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f761a7-b0ab-4263-8e70-605fc0c2829f None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:12.711562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f761a7-b0ab-4263-8e70-605fc0c2829f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:12.712151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f761a7-b0ab-4263-8e70-605fc0c2829f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:12.713613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f761a7-b0ab-4263-8e70-605fc0c2829f None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-46f761a7-b0ab-4263-8e70-605fc0c2829f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:12.723147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:12.724322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:12.725327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 651/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Sep 3 01:13:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:12.730715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b5e37-53ae-4758-b688-62a8280ddc41 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:12.836061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b5e37-53ae-4758-b688-62a8280ddc41 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:12.874913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ed953-a061-468f-b471-9644fecc8c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:12.875839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ed953-a061-468f-b471-9644fecc8c72 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:12.876193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ed953-a061-468f-b471-9644fecc8c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:12.876580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ed953-a061-468f-b471-9644fecc8c72 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:12.877544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ed953-a061-468f-b471-9644fecc8c72 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:12.877985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ed953-a061-468f-b471-9644fecc8c72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:12.880190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ed953-a061-468f-b471-9644fecc8c72 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:12.889080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 640/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Sep 3 01:13:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:12.898825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f761a7-b0ab-4263-8e70-605fc0c2829f None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:13.008989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f761a7-b0ab-4263-8e70-605fc0c2829f None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:13.043722 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0e81f-01e9-45d5-9f7d-830bb6f3dd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:13.044316 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0e81f-01e9-45d5-9f7d-830bb6f3dd38 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:13.044595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0e81f-01e9-45d5-9f7d-830bb6f3dd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:13.044863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0e81f-01e9-45d5-9f7d-830bb6f3dd38 None admin] PATH_INFO: `/v3/services` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:13.045487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0e81f-01e9-45d5-9f7d-830bb6f3dd38 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:13.045748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0e81f-01e9-45d5-9f7d-830bb6f3dd38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:13.047164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0e81f-01e9-45d5-9f7d-830bb6f3dd38 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:13.051727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 652/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Sep 3 01:13:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:14.938403 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc35f-caba-4c4c-8293-b3dc18825d6c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:14.939275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc35f-caba-4c4c-8293-b3dc18825d6c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:14.939275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc35f-caba-4c4c-8293-b3dc18825d6c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:14.941533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 641/1293] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:13:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:13:14.949476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60387d0-e712-4323-b795-3b968c9efb9c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:14.949894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60387d0-e712-4323-b795-3b968c9efb9c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:14.950068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60387d0-e712-4323-b795-3b968c9efb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:14.974548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-d60387d0-e712-4323-b795-3b968c9efb9c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:13:14.975798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d60387d0-e712-4323-b795-3b968c9efb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:13:15.008170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:15.048043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 653/1294] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:13:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:13:15.322852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bc35f-caba-4c4c-8293-b3dc18825d6c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:15.360599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:15.447537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bc35f-caba-4c4c-8293-b3dc18825d6c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:15.483280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7acaad-2888-483f-a183-6fa1d9bf6f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:15.483906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7acaad-2888-483f-a183-6fa1d9bf6f86 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:15.484182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7acaad-2888-483f-a183-6fa1d9bf6f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:15.484452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7acaad-2888-483f-a183-6fa1d9bf6f86 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:15.485113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7acaad-2888-483f-a183-6fa1d9bf6f86 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:15.486473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7acaad-2888-483f-a183-6fa1d9bf6f86 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:15.505770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 642/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Sep 3 01:13:15 2022] POST /identity/v3/services => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:13:17.439789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8afed-eed4-4f7b-ba0e-ea2b4a5eedd0 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:17.440613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8afed-eed4-4f7b-ba0e-ea2b4a5eedd0 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:17.440613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8afed-eed4-4f7b-ba0e-ea2b4a5eedd0 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:17.442818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 654/1296] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:13:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:13:17.449992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc625-69c8-4941-8b2e-1f10449c9de4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:17.450407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc625-69c8-4941-8b2e-1f10449c9de4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:17.450539 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc625-69c8-4941-8b2e-1f10449c9de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:17.469918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a29cc625-69c8-4941-8b2e-1f10449c9de4 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:13:17.471120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a29cc625-69c8-4941-8b2e-1f10449c9de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:13:17.547009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 643/1297] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:13:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 01:13:17.817716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8afed-eed4-4f7b-ba0e-ea2b4a5eedd0 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:17.937797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8afed-eed4-4f7b-ba0e-ea2b4a5eedd0 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:17.973199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be698212-d3cc-4b90-bf45-4cb90f46eee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:17.973819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be698212-d3cc-4b90-bf45-4cb90f46eee2 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:17.974098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be698212-d3cc-4b90-bf45-4cb90f46eee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:17.974370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be698212-d3cc-4b90-bf45-4cb90f46eee2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:17.974951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be698212-d3cc-4b90-bf45-4cb90f46eee2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:17.976371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be698212-d3cc-4b90-bf45-4cb90f46eee2 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-be698212-d3cc-4b90-bf45-4cb90f46eee2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:17.985567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:17.986789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:17.987818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 655/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Sep 3 01:13:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:17.993597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cc625-69c8-4941-8b2e-1f10449c9de4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:18.014502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:18.103490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cc625-69c8-4941-8b2e-1f10449c9de4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:18.141073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4abbc-964b-412b-8886-74d5b80d5cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:18.141676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4abbc-964b-412b-8886-74d5b80d5cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:18.141914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4abbc-964b-412b-8886-74d5b80d5cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:18.142216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4abbc-964b-412b-8886-74d5b80d5cc9 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:18.142833 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4abbc-964b-412b-8886-74d5b80d5cc9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:18.143126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4abbc-964b-412b-8886-74d5b80d5cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:18.144514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4abbc-964b-412b-8886-74d5b80d5cc9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:18.149831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 644/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Sep 3 01:13:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:18.156161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be698212-d3cc-4b90-bf45-4cb90f46eee2 None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:18.189858 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:18.259690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be698212-d3cc-4b90-bf45-4cb90f46eee2 None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:18.298338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a53763-a3d1-40fe-91ee-8c4751496801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:18.299321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a53763-a3d1-40fe-91ee-8c4751496801 None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:18.299702 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a53763-a3d1-40fe-91ee-8c4751496801 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:18.300124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a53763-a3d1-40fe-91ee-8c4751496801 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:18.301239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a53763-a3d1-40fe-91ee-8c4751496801 None admin] RBAC: Adding query filter params (interface=public, service_id=6331289d860a474597d0a550686d0291, region_id=RegionOne) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:18.301745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a53763-a3d1-40fe-91ee-8c4751496801 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:18.304130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a53763-a3d1-40fe-91ee-8c4751496801 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:18.313261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 656/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Sep 3 01:13:18 2022] GET /identity/v3/endpoints?service_id=6331289d860a474597d0a550686d0291&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:13:18.319288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4abbc-964b-412b-8886-74d5b80d5cc9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:18.422097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:18.442572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4abbc-964b-412b-8886-74d5b80d5cc9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:18.479011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d8ba0-3095-4bcd-8c8f-ad80a897e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:18.479679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d8ba0-3095-4bcd-8c8f-ad80a897e355 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:18.479910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d8ba0-3095-4bcd-8c8f-ad80a897e355 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:18.480180 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d8ba0-3095-4bcd-8c8f-ad80a897e355 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:18.480786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d8ba0-3095-4bcd-8c8f-ad80a897e355 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:18.482147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d8ba0-3095-4bcd-8c8f-ad80a897e355 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:18.489024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 645/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Sep 3 01:13:18 2022] GET /identity/v3/services => generated 2191 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:13:20.376476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba7725-3f62-4184-aa7b-f0d9cb0a9123 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:20.377020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba7725-3f62-4184-aa7b-f0d9cb0a9123 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:20.377020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba7725-3f62-4184-aa7b-f0d9cb0a9123 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:20.379065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 657/1302] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:13:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:13:20.386944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8afe15-f703-44f2-9d71-8b9e2894ba11 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:20.387420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8afe15-f703-44f2-9d71-8b9e2894ba11 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:20.387512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8afe15-f703-44f2-9d71-8b9e2894ba11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:20.407047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3a8afe15-f703-44f2-9d71-8b9e2894ba11 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:13:20.408267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3a8afe15-f703-44f2-9d71-8b9e2894ba11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:13:20.480590 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 646/1303] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:13:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 01:13:20.745686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba7725-3f62-4184-aa7b-f0d9cb0a9123 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:20.846298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:20.854382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba7725-3f62-4184-aa7b-f0d9cb0a9123 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:20.889333 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f643-c1da-460f-b909-37413a396d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:20.889945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f643-c1da-460f-b909-37413a396d9b None admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:20.890219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f643-c1da-460f-b909-37413a396d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:20.890482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f643-c1da-460f-b909-37413a396d9b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:20.891073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21f643-c1da-460f-b909-37413a396d9b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:20.892491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21f643-c1da-460f-b909-37413a396d9b None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application [None req-4b21f643-c1da-460f-b909-37413a396d9b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 01:13:20.901317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 01:13:20.902448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application with Lock( Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self._enter() Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application return self.creator() Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application created_value = creator( Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: ERROR keystone.server.flask.application Sep 03 01:13:20.903529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 658/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Sep 3 01:13:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 01:13:20.908682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8afe15-f703-44f2-9d71-8b9e2894ba11 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:21.000790 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:21.028550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8afe15-f703-44f2-9d71-8b9e2894ba11 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:21.065936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb6ad6-d846-4da3-9582-230ea001d38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:21.066533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6ad6-d846-4da3-9582-230ea001d38b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:21.066811 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6ad6-d846-4da3-9582-230ea001d38b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:21.067076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6ad6-d846-4da3-9582-230ea001d38b None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:21.067738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb6ad6-d846-4da3-9582-230ea001d38b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:13:21.068035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb6ad6-d846-4da3-9582-230ea001d38b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:21.069425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb6ad6-d846-4da3-9582-230ea001d38b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:21.077239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 647/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Sep 3 01:13:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:13:21.083124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f643-c1da-460f-b909-37413a396d9b None admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:13:21.187584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f643-c1da-460f-b909-37413a396d9b None admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:13:21.223024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053d5dd-cc3c-4db4-8546-deb779b82206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:13:21.223643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d5dd-cc3c-4db4-8546-deb779b82206 None admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:13:21.223917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d5dd-cc3c-4db4-8546-deb779b82206 None admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:13:21.224179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d5dd-cc3c-4db4-8546-deb779b82206 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:13:21.224834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053d5dd-cc3c-4db4-8546-deb779b82206 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:13:21.226203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053d5dd-cc3c-4db4-8546-deb779b82206 None admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:13:21.251324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 659/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:13:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:13:31.071696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=30 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:13:31.246938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:25.460390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acff84e-4721-46b4-bd1b-9f692f6aae96 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:25.460838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acff84e-4721-46b4-bd1b-9f692f6aae96 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:25.461058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acff84e-4721-46b4-bd1b-9f692f6aae96 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:25.466606 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 648/1307] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:25.468208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6786c4-3cc3-409e-bd06-9cd417ebbe17 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:25.468625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6786c4-3cc3-409e-bd06-9cd417ebbe17 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:25.468848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6786c4-3cc3-409e-bd06-9cd417ebbe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:25.654501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ed6786c4-3cc3-409e-bd06-9cd417ebbe17 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:25.657968 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ed6786c4-3cc3-409e-bd06-9cd417ebbe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:25.794666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 660/1308] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:14:26.081782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a684-9830-4325-8982-30d381efc58f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:26.082051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a684-9830-4325-8982-30d381efc58f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:26.082602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a684-9830-4325-8982-30d381efc58f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:26.084215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 649/1309] 10.222.0.39 () {54 vars in 965 bytes} [Sat Sep 3 01:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:26.091025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e10fee-2698-4c55-8a41-e076c07af4e9 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:26.091344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e10fee-2698-4c55-8a41-e076c07af4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:26.091767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e10fee-2698-4c55-8a41-e076c07af4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:26.182487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-83e10fee-2698-4c55-8a41-e076c07af4e9 None None] MFA Rules not processed for user `8bec5c8c626c40ef9906783916c49dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:26.183960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-83e10fee-2698-4c55-8a41-e076c07af4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:26.207354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:26.268409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 661/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Sat Sep 3 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:26.277499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a684-9830-4325-8982-30d381efc58f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:26.279234 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4775a684-9830-4325-8982-30d381efc58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:26.399696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a684-9830-4325-8982-30d381efc58f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:26.481239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90c71e-a175-4401-b2fe-b78ba322f900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:26.481913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90c71e-a175-4401-b2fe-b78ba322f900 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:26.482351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90c71e-a175-4401-b2fe-b78ba322f900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:26.482758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90c71e-a175-4401-b2fe-b78ba322f900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:26.485188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ca90c71e-a175-4401-b2fe-b78ba322f900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:26.547188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:26.605299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90c71e-a175-4401-b2fe-b78ba322f900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:26.606862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90c71e-a175-4401-b2fe-b78ba322f900 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:26.626092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 650/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:14:28.836701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555369f7-e321-49e2-8c50-3fe4ae34d174 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:28.837453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555369f7-e321-49e2-8c50-3fe4ae34d174 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:28.837453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555369f7-e321-49e2-8c50-3fe4ae34d174 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:28.841343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 662/1312] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:28.844820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8fbd4-594e-40fc-917c-ce979d43eb03 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:28.845260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8fbd4-594e-40fc-917c-ce979d43eb03 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:28.845355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8fbd4-594e-40fc-917c-ce979d43eb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:28.932385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-94e8fbd4-594e-40fc-917c-ce979d43eb03 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:28.933595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-94e8fbd4-594e-40fc-917c-ce979d43eb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:29.036018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 651/1313] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:29.321760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555369f7-e321-49e2-8c50-3fe4ae34d174 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:29.323328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-555369f7-e321-49e2-8c50-3fe4ae34d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:29.436991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555369f7-e321-49e2-8c50-3fe4ae34d174 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:29.514377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:29.517190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33637597-8a16-4192-9d8b-5210a3a12297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:29.517995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33637597-8a16-4192-9d8b-5210a3a12297 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:29.518650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33637597-8a16-4192-9d8b-5210a3a12297 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:29.519009 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33637597-8a16-4192-9d8b-5210a3a12297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:29.522345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-33637597-8a16-4192-9d8b-5210a3a12297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:29.645979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33637597-8a16-4192-9d8b-5210a3a12297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:29.647509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33637597-8a16-4192-9d8b-5210a3a12297 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:29.666734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 663/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:14:32.004939 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebe247-7af6-4e6c-8399-1a9f94adf3d3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:32.005548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebe247-7af6-4e6c-8399-1a9f94adf3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:32.005548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebe247-7af6-4e6c-8399-1a9f94adf3d3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:32.007419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 652/1315] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:32.013481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eb777-9d3d-4d7c-95bb-c9fa6351eceb None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:32.014199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eb777-9d3d-4d7c-95bb-c9fa6351eceb None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:32.014361 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eb777-9d3d-4d7c-95bb-c9fa6351eceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:32.098869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e85eb777-9d3d-4d7c-95bb-c9fa6351eceb None None] MFA Rules not processed for user `66691c32d587443cb7787f9e28a6a013`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:32.100202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e85eb777-9d3d-4d7c-95bb-c9fa6351eceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:32.162240 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:32.215687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 664/1316] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:32.496901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebe247-7af6-4e6c-8399-1a9f94adf3d3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:32.499318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b1ebe247-7af6-4e6c-8399-1a9f94adf3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:32.512469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:32.613251 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebe247-7af6-4e6c-8399-1a9f94adf3d3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:32.690759 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cd67b-d473-4167-84e9-ff5fa735cea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:32.691408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cd67b-d473-4167-84e9-ff5fa735cea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:32.691688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cd67b-d473-4167-84e9-ff5fa735cea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:32.691952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cd67b-d473-4167-84e9-ff5fa735cea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:32.693607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-659cd67b-d473-4167-84e9-ff5fa735cea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:32.764396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:32.812305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cd67b-d473-4167-84e9-ff5fa735cea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:32.813738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cd67b-d473-4167-84e9-ff5fa735cea5 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:32.833749 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 653/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:14:35.279299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ab1a-9bff-410e-8f79-76970bf213f0 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:35.280137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ab1a-9bff-410e-8f79-76970bf213f0 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:35.280137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ab1a-9bff-410e-8f79-76970bf213f0 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:35.282372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 665/1318] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:35.291325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d7a97-b935-416b-b1c8-00793653fd85 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:35.292002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d7a97-b935-416b-b1c8-00793653fd85 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:35.292247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d7a97-b935-416b-b1c8-00793653fd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:35.373490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6a3d7a97-b935-416b-b1c8-00793653fd85 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:35.375371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6a3d7a97-b935-416b-b1c8-00793653fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:35.500407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 654/1319] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:35.785897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438ab1a-9bff-410e-8f79-76970bf213f0 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:35.788415 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0438ab1a-9bff-410e-8f79-76970bf213f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:35.908365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438ab1a-9bff-410e-8f79-76970bf213f0 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:35.982590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87df725-fca5-4237-9f0e-8308aba9a948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:35.983186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df725-fca5-4237-9f0e-8308aba9a948 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:35.983492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df725-fca5-4237-9f0e-8308aba9a948 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:35.983761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df725-fca5-4237-9f0e-8308aba9a948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:35.985326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c87df725-fca5-4237-9f0e-8308aba9a948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:35.992761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:36.096971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87df725-fca5-4237-9f0e-8308aba9a948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:36.098405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87df725-fca5-4237-9f0e-8308aba9a948 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:36.124366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 666/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:14:38.711406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21656-476a-48ae-bfce-0e2d50a61518 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:38.711965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21656-476a-48ae-bfce-0e2d50a61518 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:38.711965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21656-476a-48ae-bfce-0e2d50a61518 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:38.713300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 655/1321] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:38.719034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa5eb-321c-484f-bd0b-26888d0e74ad None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:38.719464 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa5eb-321c-484f-bd0b-26888d0e74ad None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:38.719642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa5eb-321c-484f-bd0b-26888d0e74ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:38.789016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-26baa5eb-321c-484f-bd0b-26888d0e74ad None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:38.790221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-26baa5eb-321c-484f-bd0b-26888d0e74ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:38.850825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:38.891021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 667/1322] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:39.179851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647dff9-659a-4dbc-a7d7-19eb9c38607c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:39.180109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647dff9-659a-4dbc-a7d7-19eb9c38607c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:39.180479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647dff9-659a-4dbc-a7d7-19eb9c38607c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:39.181962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 656/1323] 10.222.0.39 () {54 vars in 965 bytes} [Sat Sep 3 01:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:39.188195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8e1a-c191-406a-a26b-4490a8cb9989 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:39.188472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8e1a-c191-406a-a26b-4490a8cb9989 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:39.188738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8e1a-c191-406a-a26b-4490a8cb9989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:39.266060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e0ff8e1a-c191-406a-a26b-4490a8cb9989 None None] MFA Rules not processed for user `8bec5c8c626c40ef9906783916c49dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:39.267406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e0ff8e1a-c191-406a-a26b-4490a8cb9989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:39.345147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 668/1324] 10.222.0.39 () {58 vars in 1062 bytes} [Sat Sep 3 01:14:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:39.354237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647dff9-659a-4dbc-a7d7-19eb9c38607c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:39.355836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2647dff9-659a-4dbc-a7d7-19eb9c38607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:39.376703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:39.461708 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647dff9-659a-4dbc-a7d7-19eb9c38607c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:39.536393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f891c0-23d8-43af-a0f0-ac44b4141d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:39.537748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f891c0-23d8-43af-a0f0-ac44b4141d59 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:39.537748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f891c0-23d8-43af-a0f0-ac44b4141d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:39.537748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f891c0-23d8-43af-a0f0-ac44b4141d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:39.539129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f7f891c0-23d8-43af-a0f0-ac44b4141d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:39.611212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:39.655191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f891c0-23d8-43af-a0f0-ac44b4141d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:39.657443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f891c0-23d8-43af-a0f0-ac44b4141d59 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:39.680550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 657/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:14:41.923410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626fc8-3648-463f-ab1a-db2cd29fff7f None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:41.923993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626fc8-3648-463f-ab1a-db2cd29fff7f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:41.923993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626fc8-3648-463f-ab1a-db2cd29fff7f None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:41.925306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 669/1326] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:41.931373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a0ac-3c39-41dc-9c1a-6c412aee78a6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:41.931824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a0ac-3c39-41dc-9c1a-6c412aee78a6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:41.932035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a0ac-3c39-41dc-9c1a-6c412aee78a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:42.003380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e9a3a0ac-3c39-41dc-9c1a-6c412aee78a6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:42.004598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e9a3a0ac-3c39-41dc-9c1a-6c412aee78a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:42.118533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 658/1327] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:42.392299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69626fc8-3648-463f-ab1a-db2cd29fff7f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:42.393922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-69626fc8-3648-463f-ab1a-db2cd29fff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:42.455348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:42.501724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69626fc8-3648-463f-ab1a-db2cd29fff7f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:42.579121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1defe9-12d5-4a93-a637-bb01d34fac2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:42.579892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1defe9-12d5-4a93-a637-bb01d34fac2f service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:42.580232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1defe9-12d5-4a93-a637-bb01d34fac2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:42.580514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1defe9-12d5-4a93-a637-bb01d34fac2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:42.582434 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ef1defe9-12d5-4a93-a637-bb01d34fac2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:42.697380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:42.700027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1defe9-12d5-4a93-a637-bb01d34fac2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:42.702161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1defe9-12d5-4a93-a637-bb01d34fac2f service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:42.722838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 670/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:14:44.661384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2effc7-6990-47b1-bd53-bd07fd76056d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:44.661853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2effc7-6990-47b1-bd53-bd07fd76056d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:44.661955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2effc7-6990-47b1-bd53-bd07fd76056d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:44.667113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 659/1329] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:44.668943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbbdbb-0215-4c51-b3fa-a0c1debb5820 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:44.669392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbbdbb-0215-4c51-b3fa-a0c1debb5820 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:44.669841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbbdbb-0215-4c51-b3fa-a0c1debb5820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:44.742330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a9dbbdbb-0215-4c51-b3fa-a0c1debb5820 None None] MFA Rules not processed for user `66691c32d587443cb7787f9e28a6a013`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:44.743563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a9dbbdbb-0215-4c51-b3fa-a0c1debb5820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:44.841431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 671/1330] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:45.146229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2effc7-6990-47b1-bd53-bd07fd76056d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:45.147850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-da2effc7-6990-47b1-bd53-bd07fd76056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:45.182589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:45.261555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2effc7-6990-47b1-bd53-bd07fd76056d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:45.349630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724adc5d-e840-47ee-90f3-1fc552e86a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:45.350324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724adc5d-e840-47ee-90f3-1fc552e86a0a service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:45.350598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724adc5d-e840-47ee-90f3-1fc552e86a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:45.350860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724adc5d-e840-47ee-90f3-1fc552e86a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:45.352508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-724adc5d-e840-47ee-90f3-1fc552e86a0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:45.434093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:45.468202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724adc5d-e840-47ee-90f3-1fc552e86a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:45.469675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724adc5d-e840-47ee-90f3-1fc552e86a0a service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:45.490364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 660/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:14:47.793171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c60d20-4a6b-4feb-b952-70a96a121c8f None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:47.793735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c60d20-4a6b-4feb-b952-70a96a121c8f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:47.793735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c60d20-4a6b-4feb-b952-70a96a121c8f None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:47.795064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 672/1332] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:47.801437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f376-eb22-4b53-9507-0ece23e7f751 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:47.802204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f376-eb22-4b53-9507-0ece23e7f751 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:47.802347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f376-eb22-4b53-9507-0ece23e7f751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:47.873724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6440f376-eb22-4b53-9507-0ece23e7f751 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:47.874946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6440f376-eb22-4b53-9507-0ece23e7f751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:47.974519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 661/1333] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:48.251651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c60d20-4a6b-4feb-b952-70a96a121c8f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:48.254134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-93c60d20-4a6b-4feb-b952-70a96a121c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:48.324860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:48.360981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c60d20-4a6b-4feb-b952-70a96a121c8f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:48.444634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570ba86-b731-45b0-90f2-bc30006ff9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:48.445156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570ba86-b731-45b0-90f2-bc30006ff9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:48.445433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570ba86-b731-45b0-90f2-bc30006ff9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:48.445724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570ba86-b731-45b0-90f2-bc30006ff9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:48.447291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d570ba86-b731-45b0-90f2-bc30006ff9f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:48.573354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570ba86-b731-45b0-90f2-bc30006ff9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:48.575494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570ba86-b731-45b0-90f2-bc30006ff9f0 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:48.588971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:48.598547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 673/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:14:50.554629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9cf3-f101-4f67-a7d8-cb16c971c1d9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:50.555519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9cf3-f101-4f67-a7d8-cb16c971c1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:50.555519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9cf3-f101-4f67-a7d8-cb16c971c1d9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:50.557635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 662/1335] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:50.563067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1de07-1eb2-43c7-914c-810a6b07aa80 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:50.563553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1de07-1eb2-43c7-914c-810a6b07aa80 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:50.563655 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1de07-1eb2-43c7-914c-810a6b07aa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:50.633780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b0d1de07-1eb2-43c7-914c-810a6b07aa80 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:50.634986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b0d1de07-1eb2-43c7-914c-810a6b07aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:50.739938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 674/1336] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:51.022369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b9cf3-f101-4f67-a7d8-cb16c971c1d9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:51.023950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d49b9cf3-f101-4f67-a7d8-cb16c971c1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:51.075200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:51.143944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b9cf3-f101-4f67-a7d8-cb16c971c1d9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:51.222379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc146799-8e28-4f1c-89a9-c4fc2c09c1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:51.222990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146799-8e28-4f1c-89a9-c4fc2c09c1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:51.223417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146799-8e28-4f1c-89a9-c4fc2c09c1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:51.223651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146799-8e28-4f1c-89a9-c4fc2c09c1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:51.225219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cc146799-8e28-4f1c-89a9-c4fc2c09c1d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:51.312638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:51.339196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc146799-8e28-4f1c-89a9-c4fc2c09c1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:51.341063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc146799-8e28-4f1c-89a9-c4fc2c09c1d5 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:51.359464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 663/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:14:53.757495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9579aa9-2a26-4917-91cd-41dce8a5cf31 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:53.758073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9579aa9-2a26-4917-91cd-41dce8a5cf31 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:53.758073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9579aa9-2a26-4917-91cd-41dce8a5cf31 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:53.759489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 675/1338] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:53.765757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01c3e-590e-494b-9adf-79b56c6eb755 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:53.766326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01c3e-590e-494b-9adf-79b56c6eb755 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:53.766420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01c3e-590e-494b-9adf-79b56c6eb755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:53.846565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d7b01c3e-590e-494b-9adf-79b56c6eb755 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:53.847820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d7b01c3e-590e-494b-9adf-79b56c6eb755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:53.956522 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 664/1339] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:14:54.240957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9579aa9-2a26-4917-91cd-41dce8a5cf31 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:54.243409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c9579aa9-2a26-4917-91cd-41dce8a5cf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:54.324987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:54.354585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9579aa9-2a26-4917-91cd-41dce8a5cf31 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:54.432709 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bcbe9-04eb-4a52-ad8f-36a823fb215c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:54.433261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bcbe9-04eb-4a52-ad8f-36a823fb215c service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:54.433537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bcbe9-04eb-4a52-ad8f-36a823fb215c service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:54.433803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bcbe9-04eb-4a52-ad8f-36a823fb215c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:54.435458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-980bcbe9-04eb-4a52-ad8f-36a823fb215c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:54.570427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bcbe9-04eb-4a52-ad8f-36a823fb215c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:54.571926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bcbe9-04eb-4a52-ad8f-36a823fb215c service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:54.594170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 676/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:14:58.601075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851449-f790-4c37-97f1-7a6b16e25073 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:58.601617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851449-f790-4c37-97f1-7a6b16e25073 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:58.601617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851449-f790-4c37-97f1-7a6b16e25073 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:58.602988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 665/1341] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:14:58.608481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f617f90-5dec-4a3c-aacb-de4b09b092d6 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:58.608882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f617f90-5dec-4a3c-aacb-de4b09b092d6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:58.609048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f617f90-5dec-4a3c-aacb-de4b09b092d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:58.614900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:58.679829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8f617f90-5dec-4a3c-aacb-de4b09b092d6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:14:58.681328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8f617f90-5dec-4a3c-aacb-de4b09b092d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:58.784442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 677/1342] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:14:59.069603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd851449-f790-4c37-97f1-7a6b16e25073 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:14:59.071216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fd851449-f790-4c37-97f1-7a6b16e25073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:59.122890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:59.181345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd851449-f790-4c37-97f1-7a6b16e25073 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:14:59.267548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437ee02-d5c5-4fd1-a1fe-2d5d66e4a55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:14:59.268146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ee02-d5c5-4fd1-a1fe-2d5d66e4a55c service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:14:59.268419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ee02-d5c5-4fd1-a1fe-2d5d66e4a55c service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:14:59.268686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ee02-d5c5-4fd1-a1fe-2d5d66e4a55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:14:59.270670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b437ee02-d5c5-4fd1-a1fe-2d5d66e4a55c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:14:59.368714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:14:59.385621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437ee02-d5c5-4fd1-a1fe-2d5d66e4a55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:14:59.386986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437ee02-d5c5-4fd1-a1fe-2d5d66e4a55c service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:14:59.405619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 666/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:01.943391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548c996-9feb-4566-bd4f-9d3228c05dec None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:01.943993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548c996-9feb-4566-bd4f-9d3228c05dec None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:01.943993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548c996-9feb-4566-bd4f-9d3228c05dec None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:01.945308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 678/1344] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:01.951370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d8975-a610-47c8-bd51-7e20d22a6fb4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:01.951902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d8975-a610-47c8-bd51-7e20d22a6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:01.951902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d8975-a610-47c8-bd51-7e20d22a6fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:02.022246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-332d8975-a610-47c8-bd51-7e20d22a6fb4 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:02.023499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-332d8975-a610-47c8-bd51-7e20d22a6fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:02.126044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 667/1345] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:02.405295 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548c996-9feb-4566-bd4f-9d3228c05dec None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:02.406944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1548c996-9feb-4566-bd4f-9d3228c05dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:02.497912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:02.517327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548c996-9feb-4566-bd4f-9d3228c05dec None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:02.598738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e708d2-93d8-4db5-ae7f-bbc5167208ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:02.599541 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e708d2-93d8-4db5-ae7f-bbc5167208ea service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:02.599828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e708d2-93d8-4db5-ae7f-bbc5167208ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:02.600081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e708d2-93d8-4db5-ae7f-bbc5167208ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:02.601863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-54e708d2-93d8-4db5-ae7f-bbc5167208ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:02.716623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e708d2-93d8-4db5-ae7f-bbc5167208ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:02.718064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e708d2-93d8-4db5-ae7f-bbc5167208ea service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:02.737245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 679/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:06.637393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7a1f5-362d-4bb9-9983-e85a809fa081 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:06.639904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7a1f5-362d-4bb9-9983-e85a809fa081 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:06.640264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7a1f5-362d-4bb9-9983-e85a809fa081 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:06.641757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 668/1347] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:06.647578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fbb90-f11e-4e56-b221-379921aa6daf None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:06.648040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fbb90-f11e-4e56-b221-379921aa6daf None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:06.648145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fbb90-f11e-4e56-b221-379921aa6daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:06.666978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:06.726768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0b8fbb90-f11e-4e56-b221-379921aa6daf None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:06.729073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0b8fbb90-f11e-4e56-b221-379921aa6daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:06.835046 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 680/1348] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:15:07.117723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7a1f5-362d-4bb9-9983-e85a809fa081 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:07.119351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-70f7a1f5-362d-4bb9-9983-e85a809fa081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:07.187269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:07.244413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7a1f5-362d-4bb9-9983-e85a809fa081 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:07.332373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66409fda-ae9b-4955-a04e-657e15879a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:07.333277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66409fda-ae9b-4955-a04e-657e15879a16 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:07.333277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66409fda-ae9b-4955-a04e-657e15879a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:07.333605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66409fda-ae9b-4955-a04e-657e15879a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:07.335345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-66409fda-ae9b-4955-a04e-657e15879a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:07.449469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:07.453550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66409fda-ae9b-4955-a04e-657e15879a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:07.456218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66409fda-ae9b-4955-a04e-657e15879a16 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:07.475474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 669/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:12.361276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599c562-0b6d-4717-b9f3-04b06ac3e3da None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:12.361732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599c562-0b6d-4717-b9f3-04b06ac3e3da None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:12.361811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599c562-0b6d-4717-b9f3-04b06ac3e3da None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:12.363778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 681/1350] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:12.368670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7c89-016d-432e-8bc3-7cfcb51eb6de None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:12.369091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7c89-016d-432e-8bc3-7cfcb51eb6de None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:12.369294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7c89-016d-432e-8bc3-7cfcb51eb6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:12.489542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d52a7c89-016d-432e-8bc3-7cfcb51eb6de None None] MFA Rules not processed for user `bac171ccd62b4c268e79a318478414ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:12.490767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d52a7c89-016d-432e-8bc3-7cfcb51eb6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:12.618122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 670/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:16.748378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e89a7-a62e-4acc-8b4f-3613d7a13dfd None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:16.748930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e89a7-a62e-4acc-8b4f-3613d7a13dfd None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:16.748930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e89a7-a62e-4acc-8b4f-3613d7a13dfd None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:16.750374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 682/1352] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:15:16.756351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80d9e6-bf17-4645-ae46-105a7e143cba None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:16.757256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80d9e6-bf17-4645-ae46-105a7e143cba None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:16.757808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80d9e6-bf17-4645-ae46-105a7e143cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:16.822118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:16.832331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=59 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:16.854359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1e80d9e6-bf17-4645-ae46-105a7e143cba None None] MFA Rules not processed for user `bac171ccd62b4c268e79a318478414ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:16.855621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1e80d9e6-bf17-4645-ae46-105a7e143cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:16.983950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 671/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:15:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:18.249515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a088-5499-44a7-ae8d-0acc4f954b07 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:18.250059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a088-5499-44a7-ae8d-0acc4f954b07 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:18.250209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a088-5499-44a7-ae8d-0acc4f954b07 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:18.251887 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 683/1354] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:18.257899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9b477-d773-4ba2-87b1-6de5f230f6db None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:18.258791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9b477-d773-4ba2-87b1-6de5f230f6db None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:18.259970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9b477-d773-4ba2-87b1-6de5f230f6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:18.343107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-38d9b477-d773-4ba2-87b1-6de5f230f6db None None] MFA Rules not processed for user `bac171ccd62b4c268e79a318478414ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:18.344385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-38d9b477-d773-4ba2-87b1-6de5f230f6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:18.387163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:18.453565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 672/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:21.971060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c237b7-5a0e-4807-9e67-2191aaf0f802 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:21.971997 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c237b7-5a0e-4807-9e67-2191aaf0f802 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:21.972275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c237b7-5a0e-4807-9e67-2191aaf0f802 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:21.974603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 684/1356] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:21.979543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79112512-3258-4cd6-993e-d78ea5102acd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:21.980042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79112512-3258-4cd6-993e-d78ea5102acd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:21.980042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79112512-3258-4cd6-993e-d78ea5102acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:22.067759 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-79112512-3258-4cd6-993e-d78ea5102acd None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:22.069638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-79112512-3258-4cd6-993e-d78ea5102acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:22.189258 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 673/1357] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:22.483914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4e8bb-fb03-490c-a4ac-fb335092aab9 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:22.484185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4e8bb-fb03-490c-a4ac-fb335092aab9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:22.484644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4e8bb-fb03-490c-a4ac-fb335092aab9 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:22.486016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 685/1358] 10.222.0.39 () {54 vars in 962 bytes} [Sat Sep 3 01:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:22.494366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bf886-8f3d-4271-9b54-887024a4b9bc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:22.494929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bf886-8f3d-4271-9b54-887024a4b9bc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:22.495521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bf886-8f3d-4271-9b54-887024a4b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:22.518798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:22.608365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4a0bf886-8f3d-4271-9b54-887024a4b9bc None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:22.609577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4a0bf886-8f3d-4271-9b54-887024a4b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:22.735755 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 674/1359] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Sep 3 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:22.743517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4e8bb-fb03-490c-a4ac-fb335092aab9 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:22.745305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-fbe4e8bb-fb03-490c-a4ac-fb335092aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:22.927135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4e8bb-fb03-490c-a4ac-fb335092aab9 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:23.021530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:23.065344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1722e-d684-4a27-bf51-7ad0e41a23ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:23.066101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1722e-d684-4a27-bf51-7ad0e41a23ee service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:23.066487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1722e-d684-4a27-bf51-7ad0e41a23ee service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:23.066852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1722e-d684-4a27-bf51-7ad0e41a23ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:23.068594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3ac1722e-d684-4a27-bf51-7ad0e41a23ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:23.161202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1722e-d684-4a27-bf51-7ad0e41a23ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:23.162919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1722e-d684-4a27-bf51-7ad0e41a23ee service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:23.182940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 686/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:15:25.343908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341af1-9e94-4960-9ab6-e1f75dab51e7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:25.344458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341af1-9e94-4960-9ab6-e1f75dab51e7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:25.344458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341af1-9e94-4960-9ab6-e1f75dab51e7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:25.346537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 675/1361] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:25.351795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1efd98-277f-4bfe-9326-c3e0976597da None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:25.352256 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1efd98-277f-4bfe-9326-c3e0976597da None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:25.352335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1efd98-277f-4bfe-9326-c3e0976597da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:25.427631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-fc1efd98-277f-4bfe-9326-c3e0976597da None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:25.428941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-fc1efd98-277f-4bfe-9326-c3e0976597da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:25.482533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:25.557083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 687/1362] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:25.850418 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341af1-9e94-4960-9ab6-e1f75dab51e7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:25.852077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0b341af1-9e94-4960-9ab6-e1f75dab51e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:25.921339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:26.019384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341af1-9e94-4960-9ab6-e1f75dab51e7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:26.146059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c104877-d9df-41c4-80c3-4735c6abf541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:26.146688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c104877-d9df-41c4-80c3-4735c6abf541 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:26.146971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c104877-d9df-41c4-80c3-4735c6abf541 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:26.147242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c104877-d9df-41c4-80c3-4735c6abf541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:26.148887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8c104877-d9df-41c4-80c3-4735c6abf541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:26.174906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:26.262125 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c104877-d9df-41c4-80c3-4735c6abf541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:26.263927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c104877-d9df-41c4-80c3-4735c6abf541 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:26.288271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 676/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:28.514406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9a375-c885-478c-b177-9ee339072885 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:28.514949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9a375-c885-478c-b177-9ee339072885 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:28.514949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9a375-c885-478c-b177-9ee339072885 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:28.516206 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 688/1364] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:28.521853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895e13-f62c-4904-a38f-32255e448b13 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:28.522740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895e13-f62c-4904-a38f-32255e448b13 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:28.523024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895e13-f62c-4904-a38f-32255e448b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:28.596682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ad895e13-f62c-4904-a38f-32255e448b13 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:28.597918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ad895e13-f62c-4904-a38f-32255e448b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:28.697437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:28.700449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 677/1365] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:15:28.990324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5994d-357d-4a09-b539-7d174b7f3cfc None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:28.990861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5994d-357d-4a09-b539-7d174b7f3cfc None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:28.991102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5994d-357d-4a09-b539-7d174b7f3cfc None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:28.992695 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 689/1366] 10.222.0.39 () {54 vars in 962 bytes} [Sat Sep 3 01:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:28.998368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f8529-5e38-4961-abb7-e2cd2928eedb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:28.998633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f8529-5e38-4961-abb7-e2cd2928eedb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:28.999048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f8529-5e38-4961-abb7-e2cd2928eedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:29.085483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f25f8529-5e38-4961-abb7-e2cd2928eedb None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:29.086721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f25f8529-5e38-4961-abb7-e2cd2928eedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:29.221072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 678/1367] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Sep 3 01:15:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:29.229432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5994d-357d-4a09-b539-7d174b7f3cfc None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:29.230997 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-90a5994d-357d-4a09-b539-7d174b7f3cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:29.385781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5994d-357d-4a09-b539-7d174b7f3cfc None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:29.406961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:29.510744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebe51b-b20f-4ae4-a7b3-ad08d0fd5d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:29.511400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebe51b-b20f-4ae4-a7b3-ad08d0fd5d1b service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:29.511686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebe51b-b20f-4ae4-a7b3-ad08d0fd5d1b service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:29.511965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebe51b-b20f-4ae4-a7b3-ad08d0fd5d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:29.513797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-62ebe51b-b20f-4ae4-a7b3-ad08d0fd5d1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:29.606902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebe51b-b20f-4ae4-a7b3-ad08d0fd5d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:29.608686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebe51b-b20f-4ae4-a7b3-ad08d0fd5d1b service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:29.628512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 690/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:30.101117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9b7d9-6931-4c1d-a4c0-136cb101a80d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:30.101674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9b7d9-6931-4c1d-a4c0-136cb101a80d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:30.101674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9b7d9-6931-4c1d-a4c0-136cb101a80d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:30.103229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 679/1369] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:30.108453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1401bc-952d-4c58-a293-186a07a2dbae None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:30.108704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1401bc-952d-4c58-a293-186a07a2dbae None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:30.109010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1401bc-952d-4c58-a293-186a07a2dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:30.141424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:30.179170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8d1401bc-952d-4c58-a293-186a07a2dbae None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:30.179170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8d1401bc-952d-4c58-a293-186a07a2dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:30.278771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 691/1370] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:30.873893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3349b18-3472-4714-965a-04a7ed28f088 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:30.873893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3349b18-3472-4714-965a-04a7ed28f088 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:30.873893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3349b18-3472-4714-965a-04a7ed28f088 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:30.875243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 680/1371] 10.222.0.39 () {54 vars in 964 bytes} [Sat Sep 3 01:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:15:30.880515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b420f8-e239-4af4-83fe-8ef253f50d6b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:30.881107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b420f8-e239-4af4-83fe-8ef253f50d6b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:30.881107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b420f8-e239-4af4-83fe-8ef253f50d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:30.962258 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e0b420f8-e239-4af4-83fe-8ef253f50d6b None None] MFA Rules not processed for user `248ccaa14fce4726826a16c4d3e6ca54`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:30.963844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e0b420f8-e239-4af4-83fe-8ef253f50d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:31.021056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:31.060099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 692/1372] 10.222.0.39 () {58 vars in 1061 bytes} [Sat Sep 3 01:15:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:31.068800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3349b18-3472-4714-965a-04a7ed28f088 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:31.070456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a3349b18-3472-4714-965a-04a7ed28f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:31.145347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:31.208817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3349b18-3472-4714-965a-04a7ed28f088 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:31.307381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002c941-e3ee-4120-aab5-dd501fe4e87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:31.308003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002c941-e3ee-4120-aab5-dd501fe4e87e service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:31.308280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002c941-e3ee-4120-aab5-dd501fe4e87e service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:31.308723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002c941-e3ee-4120-aab5-dd501fe4e87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:31.310444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6002c941-e3ee-4120-aab5-dd501fe4e87e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:31.433968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:31.448630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002c941-e3ee-4120-aab5-dd501fe4e87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:31.450094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002c941-e3ee-4120-aab5-dd501fe4e87e service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:31.471854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 681/1373] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:31.663960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83c26-90e5-4925-a761-df465e4f2f95 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:31.664140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83c26-90e5-4925-a761-df465e4f2f95 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:31.664363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83c26-90e5-4925-a761-df465e4f2f95 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:31.667213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 693/1374] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:31.672463 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca159a3-0c20-409c-8c80-25ad6a241d32 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:31.672835 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca159a3-0c20-409c-8c80-25ad6a241d32 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:31.673204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca159a3-0c20-409c-8c80-25ad6a241d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:31.748017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3ca159a3-0c20-409c-8c80-25ad6a241d32 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:31.749265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3ca159a3-0c20-409c-8c80-25ad6a241d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:31.851043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 682/1375] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:32.134744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83c26-90e5-4925-a761-df465e4f2f95 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:32.136844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d2e83c26-90e5-4925-a761-df465e4f2f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:32.291547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83c26-90e5-4925-a761-df465e4f2f95 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:32.343093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:32.404343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed543c-da4d-4af4-a7a6-5b7465163abd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:32.404862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed543c-da4d-4af4-a7a6-5b7465163abd service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:32.405133 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed543c-da4d-4af4-a7a6-5b7465163abd service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:32.405396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed543c-da4d-4af4-a7a6-5b7465163abd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:32.407326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-88ed543c-da4d-4af4-a7a6-5b7465163abd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:32.495015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed543c-da4d-4af4-a7a6-5b7465163abd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:32.496644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed543c-da4d-4af4-a7a6-5b7465163abd service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:32.515140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 694/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:34.479224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327890cc-012a-4427-a2fc-31057fe5e314 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:34.479750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327890cc-012a-4427-a2fc-31057fe5e314 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:34.479842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327890cc-012a-4427-a2fc-31057fe5e314 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:34.481253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 683/1377] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:34.486691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9243fc-34e8-4cb6-aadc-c50dd6a7ed67 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:34.487120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9243fc-34e8-4cb6-aadc-c50dd6a7ed67 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:34.487278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9243fc-34e8-4cb6-aadc-c50dd6a7ed67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:34.573946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2b9243fc-34e8-4cb6-aadc-c50dd6a7ed67 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:34.575140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2b9243fc-34e8-4cb6-aadc-c50dd6a7ed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:34.582218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:34.675528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 695/1378] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:15:34.985949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327890cc-012a-4427-a2fc-31057fe5e314 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:34.990924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-327890cc-012a-4427-a2fc-31057fe5e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:35.080574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:35.170773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327890cc-012a-4427-a2fc-31057fe5e314 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:35.294721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054502c5-9290-4baf-abbf-b5ef8e6ae7de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:35.295356 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054502c5-9290-4baf-abbf-b5ef8e6ae7de service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:35.295631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054502c5-9290-4baf-abbf-b5ef8e6ae7de service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:35.295898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054502c5-9290-4baf-abbf-b5ef8e6ae7de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:35.297575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-054502c5-9290-4baf-abbf-b5ef8e6ae7de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:35.317489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:35.393498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054502c5-9290-4baf-abbf-b5ef8e6ae7de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:35.395404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054502c5-9290-4baf-abbf-b5ef8e6ae7de service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:35.414360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 684/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:37.371020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c271f2-f1a0-4c56-a922-4862622f1ffa None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:37.371513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c271f2-f1a0-4c56-a922-4862622f1ffa None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:37.371784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c271f2-f1a0-4c56-a922-4862622f1ffa None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:37.373402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 696/1380] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:37.378655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bde78-40bc-4b11-86ac-27b2d6feddf9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:37.379079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bde78-40bc-4b11-86ac-27b2d6feddf9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:37.379520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bde78-40bc-4b11-86ac-27b2d6feddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:37.449452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e81bde78-40bc-4b11-86ac-27b2d6feddf9 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:37.450750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e81bde78-40bc-4b11-86ac-27b2d6feddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:37.552649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:37.560100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 685/1381] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:37.850906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c271f2-f1a0-4c56-a922-4862622f1ffa None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:37.852678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f0c271f2-f1a0-4c56-a922-4862622f1ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:38.009408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:38.023431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c271f2-f1a0-4c56-a922-4862622f1ffa None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:38.153058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378b71-635a-4827-b8b4-f6f41cbaed8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:38.153696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378b71-635a-4827-b8b4-f6f41cbaed8c service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:38.153978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378b71-635a-4827-b8b4-f6f41cbaed8c service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:38.154246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378b71-635a-4827-b8b4-f6f41cbaed8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:38.155858 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-92378b71-635a-4827-b8b4-f6f41cbaed8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:38.268325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378b71-635a-4827-b8b4-f6f41cbaed8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:38.270107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378b71-635a-4827-b8b4-f6f41cbaed8c service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:38.282574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:38.293653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 697/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:40.560671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd076bb-d493-418a-a80b-5e55cbecc644 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:40.561249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd076bb-d493-418a-a80b-5e55cbecc644 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:40.561249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd076bb-d493-418a-a80b-5e55cbecc644 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:40.562556 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 686/1383] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:40.568774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20321ed-6f7f-4299-a88a-fd65b016bf77 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:40.569301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20321ed-6f7f-4299-a88a-fd65b016bf77 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:40.569301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20321ed-6f7f-4299-a88a-fd65b016bf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:40.650847 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f20321ed-6f7f-4299-a88a-fd65b016bf77 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:40.652758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f20321ed-6f7f-4299-a88a-fd65b016bf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:40.773653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 698/1384] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:41.130411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd076bb-d493-418a-a80b-5e55cbecc644 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:41.132016 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4dd076bb-d493-418a-a80b-5e55cbecc644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:41.295583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd076bb-d493-418a-a80b-5e55cbecc644 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:41.372852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:41.422248 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af106f82-4376-4d53-a239-d72d2c1ecd02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:41.422864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106f82-4376-4d53-a239-d72d2c1ecd02 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:41.423136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106f82-4376-4d53-a239-d72d2c1ecd02 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:41.423439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106f82-4376-4d53-a239-d72d2c1ecd02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:41.425048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-af106f82-4376-4d53-a239-d72d2c1ecd02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:41.546566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106f82-4376-4d53-a239-d72d2c1ecd02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:41.548146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106f82-4376-4d53-a239-d72d2c1ecd02 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:41.567358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 687/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:43.482077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ff524-faba-4e01-b203-25ccba97b3a4 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:43.482608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ff524-faba-4e01-b203-25ccba97b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:43.482608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ff524-faba-4e01-b203-25ccba97b3a4 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:43.483914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 699/1386] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:43.491279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb11c9-431f-4a39-b1c2-114a30aa7849 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:43.491739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb11c9-431f-4a39-b1c2-114a30aa7849 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:43.491991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb11c9-431f-4a39-b1c2-114a30aa7849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:43.584162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cbcb11c9-431f-4a39-b1c2-114a30aa7849 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:43.585575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cbcb11c9-431f-4a39-b1c2-114a30aa7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:43.620694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:43.687592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 688/1387] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:43.976986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ff524-faba-4e01-b203-25ccba97b3a4 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:43.978551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d64ff524-faba-4e01-b203-25ccba97b3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:44.056680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:44.133374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ff524-faba-4e01-b203-25ccba97b3a4 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:44.255028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727c6da-6080-4b18-83ce-cbf39eb0a34f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:44.255591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727c6da-6080-4b18-83ce-cbf39eb0a34f service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:44.255869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727c6da-6080-4b18-83ce-cbf39eb0a34f service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:44.256142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727c6da-6080-4b18-83ce-cbf39eb0a34f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:44.257759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7727c6da-6080-4b18-83ce-cbf39eb0a34f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:44.295970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:44.358344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727c6da-6080-4b18-83ce-cbf39eb0a34f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:44.360824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727c6da-6080-4b18-83ce-cbf39eb0a34f service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:44.382722 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 700/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:46.325998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b98f-be6c-428c-ab81-e73775571251 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:46.326597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b98f-be6c-428c-ab81-e73775571251 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:46.326597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b98f-be6c-428c-ab81-e73775571251 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:46.328007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 689/1389] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:46.333529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a993714-5916-491d-a60a-fae6b625382c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:46.333982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a993714-5916-491d-a60a-fae6b625382c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:46.334093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a993714-5916-491d-a60a-fae6b625382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:46.401972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6a993714-5916-491d-a60a-fae6b625382c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:46.403164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6a993714-5916-491d-a60a-fae6b625382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:46.477527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fcc3a-0eb3-4dd7-942b-d5bd1c502c6e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:46.477734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fcc3a-0eb3-4dd7-942b-d5bd1c502c6e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:46.477993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fcc3a-0eb3-4dd7-942b-d5bd1c502c6e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:46.479643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 690/1390] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:15:46.484373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b910-f264-4769-9191-13f54fc0f983 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:46.484707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b910-f264-4769-9191-13f54fc0f983 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:46.485001 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b910-f264-4769-9191-13f54fc0f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:46.502980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 701/1391] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:46.554691 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5621b910-f264-4769-9191-13f54fc0f983 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:46.556329 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5621b910-f264-4769-9191-13f54fc0f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:46.659739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 691/1392] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:15:46.809756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a993714-5916-491d-a60a-fae6b625382c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:46.811001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6a993714-5916-491d-a60a-fae6b625382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:46.825688 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:46.944605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a993714-5916-491d-a60a-fae6b625382c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:46.965191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b9c0-0348-4390-ac62-d16536833ce2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:46.965472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b9c0-0348-4390-ac62-d16536833ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:46.965740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b9c0-0348-4390-ac62-d16536833ce2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:46.967233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 692/1393] 10.222.0.39 () {54 vars in 961 bytes} [Sat Sep 3 01:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:46.972697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77334296-bce5-4e7a-b48d-373f3f0902cd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:46.972983 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77334296-bce5-4e7a-b48d-373f3f0902cd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:46.973263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77334296-bce5-4e7a-b48d-373f3f0902cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:46.989876 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:47.051051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-77334296-bce5-4e7a-b48d-373f3f0902cd None None] MFA Rules not processed for user `54131719962e4463b0b874916cb40973`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:47.052075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-77334296-bce5-4e7a-b48d-373f3f0902cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:47.066823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271be7c-5224-4972-a9f4-fbb035bea87b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:47.067476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271be7c-5224-4972-a9f4-fbb035bea87b service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:47.067753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271be7c-5224-4972-a9f4-fbb035bea87b service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:47.068029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271be7c-5224-4972-a9f4-fbb035bea87b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:47.069625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c271be7c-5224-4972-a9f4-fbb035bea87b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:47.078579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:47.130637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 693/1394] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Sep 3 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:15:47.138318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77334296-bce5-4e7a-b48d-373f3f0902cd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:47.146139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77334296-bce5-4e7a-b48d-373f3f0902cd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:47.162160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271be7c-5224-4972-a9f4-fbb035bea87b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:47.163880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271be7c-5224-4972-a9f4-fbb035bea87b service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:47.184079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 702/1395] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:47.224328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30a758-ab56-4d7c-823c-3b64148325c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54131719962e4463b0b874916cb40973', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:47.224954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a758-ab56-4d7c-823c-3b64148325c0 service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:47.225233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a758-ab56-4d7c-823c-3b64148325c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:47.225607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a758-ab56-4d7c-823c-3b64148325c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:47.227097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ab30a758-ab56-4d7c-823c-3b64148325c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:47.259196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:47.352453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30a758-ab56-4d7c-823c-3b64148325c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:47.353931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30a758-ab56-4d7c-823c-3b64148325c0 service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:47.375411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 694/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:15:48.139789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9b529-a673-4551-a905-883f17abe130 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:48.140392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9b529-a673-4551-a905-883f17abe130 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:48.140752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9b529-a673-4551-a905-883f17abe130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:48.226897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-d7a9b529-a673-4551-a905-883f17abe130 None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:48.228184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d7a9b529-a673-4551-a905-883f17abe130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:48.318024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:48.323578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 703/1397] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:48.364556 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7127d-cf54-4a22-9ae2-0d6121f44b03 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:48.365083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7127d-cf54-4a22-9ae2-0d6121f44b03 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:48.365083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7127d-cf54-4a22-9ae2-0d6121f44b03 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:48.366445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 695/1398] 10.222.0.39 () {54 vars in 943 bytes} [Sat Sep 3 01:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:48.372738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b966-5bc9-456d-976a-79f7048b59fe None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:48.373024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b966-5bc9-456d-976a-79f7048b59fe None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:48.373294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b966-5bc9-456d-976a-79f7048b59fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:48.456555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4452b966-5bc9-456d-976a-79f7048b59fe None None] MFA Rules not processed for user `4a844df7e3574911b6ea31e7d7bee715`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:48.457793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4452b966-5bc9-456d-976a-79f7048b59fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:48.569453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 704/1399] 10.222.0.39 () {58 vars in 1040 bytes} [Sat Sep 3 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:48.579835 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7127d-cf54-4a22-9ae2-0d6121f44b03 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:48.581378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e3e7127d-cf54-4a22-9ae2-0d6121f44b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:48.732661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:48.735615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7127d-cf54-4a22-9ae2-0d6121f44b03 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:48.844237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca35ff-2d40-4881-b81a-4f5fbb49f84c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:48.844855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca35ff-2d40-4881-b81a-4f5fbb49f84c service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:48.845131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca35ff-2d40-4881-b81a-4f5fbb49f84c service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:48.845400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca35ff-2d40-4881-b81a-4f5fbb49f84c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:48.847054 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b7ca35ff-2d40-4881-b81a-4f5fbb49f84c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:48.933887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca35ff-2d40-4881-b81a-4f5fbb49f84c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:48.935540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca35ff-2d40-4881-b81a-4f5fbb49f84c service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:48.944315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 696/1400] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:15:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:15:49.142411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392a8e-1dcd-4efc-9542-1d4819d7c432 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:49.142954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392a8e-1dcd-4efc-9542-1d4819d7c432 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:49.143158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392a8e-1dcd-4efc-9542-1d4819d7c432 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:49.144950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 705/1401] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:49.150089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef7f9-d777-4546-a643-3453adfe25b8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:49.150371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef7f9-d777-4546-a643-3453adfe25b8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:49.150641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef7f9-d777-4546-a643-3453adfe25b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:49.195962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:49.228261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fa6ef7f9-d777-4546-a643-3453adfe25b8 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:49.229508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fa6ef7f9-d777-4546-a643-3453adfe25b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:49.338107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 697/1402] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:49.629550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392a8e-1dcd-4efc-9542-1d4819d7c432 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:49.631146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bb392a8e-1dcd-4efc-9542-1d4819d7c432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:49.698943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:49.789588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392a8e-1dcd-4efc-9542-1d4819d7c432 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:49.912595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf22f0d-d0e6-491e-b265-1da6b6891ca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:49.913125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22f0d-d0e6-491e-b265-1da6b6891ca3 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:49.913409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22f0d-d0e6-491e-b265-1da6b6891ca3 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:49.917074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22f0d-d0e6-491e-b265-1da6b6891ca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:49.917263 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-abf22f0d-d0e6-491e-b265-1da6b6891ca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:49.937354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:50.020884 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf22f0d-d0e6-491e-b265-1da6b6891ca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:50.022572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf22f0d-d0e6-491e-b265-1da6b6891ca3 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:50.042318 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 706/1403] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:52.080812 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5973f78-ccaa-46d9-a057-1727ab50622b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:52.081431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5973f78-ccaa-46d9-a057-1727ab50622b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:52.081431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5973f78-ccaa-46d9-a057-1727ab50622b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:52.083276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 698/1404] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:52.090362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876089c3-0ccf-451e-86e2-e595e7cc9b72 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:52.090831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876089c3-0ccf-451e-86e2-e595e7cc9b72 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:52.091019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876089c3-0ccf-451e-86e2-e595e7cc9b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:52.163498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-876089c3-0ccf-451e-86e2-e595e7cc9b72 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:52.164727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-876089c3-0ccf-451e-86e2-e595e7cc9b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:52.272860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:52.280107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 707/1405] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:52.565891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5973f78-ccaa-46d9-a057-1727ab50622b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:52.567470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c5973f78-ccaa-46d9-a057-1727ab50622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:52.678857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:52.725525 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5973f78-ccaa-46d9-a057-1727ab50622b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:52.848100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a5864-a5f4-4c8d-83d8-75e0b4d78106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:52.848869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a5864-a5f4-4c8d-83d8-75e0b4d78106 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:52.849153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a5864-a5f4-4c8d-83d8-75e0b4d78106 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:52.849428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a5864-a5f4-4c8d-83d8-75e0b4d78106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:52.851097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-480a5864-a5f4-4c8d-83d8-75e0b4d78106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:52.939335 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:52.960313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a5864-a5f4-4c8d-83d8-75e0b4d78106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:52.961962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a5864-a5f4-4c8d-83d8-75e0b4d78106 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:52.989865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 699/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:15:54.978367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd266d24-d89e-42f6-b617-b05ebc32569c None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:54.978958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd266d24-d89e-42f6-b617-b05ebc32569c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:54.978958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd266d24-d89e-42f6-b617-b05ebc32569c None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:54.982136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 708/1407] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:15:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:15:54.987566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41079d36-0012-4da2-bb1f-191b2824af8a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:54.988036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41079d36-0012-4da2-bb1f-191b2824af8a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:54.988127 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41079d36-0012-4da2-bb1f-191b2824af8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:55.062068 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-41079d36-0012-4da2-bb1f-191b2824af8a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:15:55.063592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-41079d36-0012-4da2-bb1f-191b2824af8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:55.183093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 700/1408] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:15:55.474815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd266d24-d89e-42f6-b617-b05ebc32569c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:15:55.476546 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-cd266d24-d89e-42f6-b617-b05ebc32569c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:55.641030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd266d24-d89e-42f6-b617-b05ebc32569c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:15:55.718480 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:15:55.772520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef853c8-710b-4708-9045-1b0f43bcdd3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:15:55.773513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef853c8-710b-4708-9045-1b0f43bcdd3e service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:15:55.773912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef853c8-710b-4708-9045-1b0f43bcdd3e service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:15:55.774191 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef853c8-710b-4708-9045-1b0f43bcdd3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:15:55.776062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bef853c8-710b-4708-9045-1b0f43bcdd3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:15:55.882585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef853c8-710b-4708-9045-1b0f43bcdd3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:15:55.883749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef853c8-710b-4708-9045-1b0f43bcdd3e service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:15:55.911921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 709/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:05.181998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=79 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:05.907426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=64 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:11.186394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3db4d3-d86d-456d-8a79-f576d0e97ca1 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:11.186866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3db4d3-d86d-456d-8a79-f576d0e97ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:11.186968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3db4d3-d86d-456d-8a79-f576d0e97ca1 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:11.188421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 701/1410] 10.222.0.39 () {54 vars in 918 bytes} [Sat Sep 3 01:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:11.193845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dc2e3-5059-4bbe-940a-36e004f15500 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:11.194347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dc2e3-5059-4bbe-940a-36e004f15500 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:11.194347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dc2e3-5059-4bbe-940a-36e004f15500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:11.272833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8a0dc2e3-5059-4bbe-940a-36e004f15500 None None] MFA Rules not processed for user `bac171ccd62b4c268e79a318478414ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:11.274037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8a0dc2e3-5059-4bbe-940a-36e004f15500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:11.505030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 710/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Sep 3 01:16:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:11.526552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdac03-61e4-4724-b4f8-89f03183bda8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:11.526810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdac03-61e4-4724-b4f8-89f03183bda8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:11.527039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdac03-61e4-4724-b4f8-89f03183bda8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:11.528439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 702/1412] 10.222.0.39 () {54 vars in 918 bytes} [Sat Sep 3 01:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:11.535412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ea324-0207-4ae0-b249-df021414076b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:11.535700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ea324-0207-4ae0-b249-df021414076b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:11.535967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ea324-0207-4ae0-b249-df021414076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:11.621520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:11.624549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4a7ea324-0207-4ae0-b249-df021414076b None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:11.626602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4a7ea324-0207-4ae0-b249-df021414076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:11.753073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 711/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Sep 3 01:16:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:14.150632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba69eb-fa47-4596-8442-4ccc2c26fa5c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:14.151564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba69eb-fa47-4596-8442-4ccc2c26fa5c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:14.151564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba69eb-fa47-4596-8442-4ccc2c26fa5c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:14.153964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:14.162622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0ad2-fd0d-473d-96eb-120c99689485 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:14.163376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0ad2-fd0d-473d-96eb-120c99689485 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:14.163583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0ad2-fd0d-473d-96eb-120c99689485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:14.238072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e38c0ad2-fd0d-473d-96eb-120c99689485 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:14.239420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e38c0ad2-fd0d-473d-96eb-120c99689485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:14.300899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:14.348564 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:14.640636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba69eb-fa47-4596-8442-4ccc2c26fa5c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:14.642355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-40ba69eb-fa47-4596-8442-4ccc2c26fa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:14.794614 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba69eb-fa47-4596-8442-4ccc2c26fa5c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:14.871689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:14.912754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b91983-215d-4e31-aa6f-d4e08c9dc15f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:14.913372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b91983-215d-4e31-aa6f-d4e08c9dc15f service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:14.913648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b91983-215d-4e31-aa6f-d4e08c9dc15f service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:14.913900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b91983-215d-4e31-aa6f-d4e08c9dc15f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:14.915544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-45b91983-215d-4e31-aa6f-d4e08c9dc15f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:15.019479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b91983-215d-4e31-aa6f-d4e08c9dc15f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:15.021643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b91983-215d-4e31-aa6f-d4e08c9dc15f service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:15.041524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 704/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:15.934354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38208-5528-4c8a-a812-f4ab2d30ac19 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:15.935362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38208-5528-4c8a-a812-f4ab2d30ac19 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:15.935362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38208-5528-4c8a-a812-f4ab2d30ac19 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:15.937497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:16:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:15.944386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7012eb-fbb9-44d4-94b3-d6f1f3ca6670 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:15.944841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7012eb-fbb9-44d4-94b3-d6f1f3ca6670 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:15.944953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7012eb-fbb9-44d4-94b3-d6f1f3ca6670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:16.028175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2f7012eb-fbb9-44d4-94b3-d6f1f3ca6670 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:16.029389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2f7012eb-fbb9-44d4-94b3-d6f1f3ca6670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:16.057673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:16.130765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:16:16.291806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a38208-5528-4c8a-a812-f4ab2d30ac19 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:16.294126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a9a38208-5528-4c8a-a812-f4ab2d30ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:16.446866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a38208-5528-4c8a-a812-f4ab2d30ac19 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:16.491934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:16.571846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac7b7b-5ae7-41e2-b903-d287d94bb3b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:16.572356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac7b7b-5ae7-41e2-b903-d287d94bb3b4 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:16.572633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac7b7b-5ae7-41e2-b903-d287d94bb3b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:16.572896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac7b7b-5ae7-41e2-b903-d287d94bb3b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:16.574486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-20ac7b7b-5ae7-41e2-b903-d287d94bb3b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:16.676639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac7b7b-5ae7-41e2-b903-d287d94bb3b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:16.678280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac7b7b-5ae7-41e2-b903-d287d94bb3b4 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:16.697744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 714/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:17.613445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4960c-efde-4f9c-843e-3372420b7f00 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:17.614338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4960c-efde-4f9c-843e-3372420b7f00 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:17.614503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4960c-efde-4f9c-843e-3372420b7f00 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:17.616694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:16:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:17.625374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c406b92-91c4-4bae-9e31-f2a145813c80 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:17.625789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c406b92-91c4-4bae-9e31-f2a145813c80 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:17.625979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c406b92-91c4-4bae-9e31-f2a145813c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:17.685303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:17.707865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7c406b92-91c4-4bae-9e31-f2a145813c80 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:17.709351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7c406b92-91c4-4bae-9e31-f2a145813c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:17.812161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:17.969826 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4960c-efde-4f9c-843e-3372420b7f00 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:17.972224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-89e4960c-efde-4f9c-843e-3372420b7f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:18.141224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4960c-efde-4f9c-843e-3372420b7f00 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:18.160307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:18.279561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595de6-2f34-498a-9579-2c9fe12edb3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:18.280262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595de6-2f34-498a-9579-2c9fe12edb3d service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:18.280518 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595de6-2f34-498a-9579-2c9fe12edb3d service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:18.280808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595de6-2f34-498a-9579-2c9fe12edb3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:18.283359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1d595de6-2f34-498a-9579-2c9fe12edb3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:18.376598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d595de6-2f34-498a-9579-2c9fe12edb3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:18.378230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d595de6-2f34-498a-9579-2c9fe12edb3d service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:18.396456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 707/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:19.288150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93737f51-1e13-49be-b03a-d56e78a12c9f None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:19.288757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93737f51-1e13-49be-b03a-d56e78a12c9f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:19.288757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93737f51-1e13-49be-b03a-d56e78a12c9f None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:19.290063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:19.296474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8210f-60ec-4d9d-a49b-d1631ade5af5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:19.297168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8210f-60ec-4d9d-a49b-d1631ade5af5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:19.297370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8210f-60ec-4d9d-a49b-d1631ade5af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:19.319730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:19.386676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0de8210f-60ec-4d9d-a49b-d1631ade5af5 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:19.387918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0de8210f-60ec-4d9d-a49b-d1631ade5af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:19.501452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:19.659078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93737f51-1e13-49be-b03a-d56e78a12c9f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:19.660645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-93737f51-1e13-49be-b03a-d56e78a12c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:19.772040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:19.807727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93737f51-1e13-49be-b03a-d56e78a12c9f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:19.924874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65628b4d-3146-44b4-8cec-c09956a8a7ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:19.925483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65628b4d-3146-44b4-8cec-c09956a8a7ac service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:19.925763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65628b4d-3146-44b4-8cec-c09956a8a7ac service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:19.926035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65628b4d-3146-44b4-8cec-c09956a8a7ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:19.927890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-65628b4d-3146-44b4-8cec-c09956a8a7ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:20.008118 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:20.022473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65628b4d-3146-44b4-8cec-c09956a8a7ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:20.024032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65628b4d-3146-44b4-8cec-c09956a8a7ac service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:20.042120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 717/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:20.903175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf00c3-b41d-421b-ab92-a30edd463114 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:20.904096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf00c3-b41d-421b-ab92-a30edd463114 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:20.904096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf00c3-b41d-421b-ab92-a30edd463114 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:20.906257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:16:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:20.913205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68bad-cf74-4a4b-8034-0fe810d8c081 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:20.913878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68bad-cf74-4a4b-8034-0fe810d8c081 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:20.913878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68bad-cf74-4a4b-8034-0fe810d8c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:20.998422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2cb68bad-cf74-4a4b-8034-0fe810d8c081 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:20.999718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2cb68bad-cf74-4a4b-8034-0fe810d8c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:21.098030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:21.247332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf00c3-b41d-421b-ab92-a30edd463114 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:21.249666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e3bf00c3-b41d-421b-ab92-a30edd463114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:21.339924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:21.411653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf00c3-b41d-421b-ab92-a30edd463114 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:21.531352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161367a-60f3-45b0-aac5-2a28e804351e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:21.531904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161367a-60f3-45b0-aac5-2a28e804351e service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:21.532179 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161367a-60f3-45b0-aac5-2a28e804351e service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:21.532448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161367a-60f3-45b0-aac5-2a28e804351e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:21.534076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2161367a-60f3-45b0-aac5-2a28e804351e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:21.590088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:21.633427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161367a-60f3-45b0-aac5-2a28e804351e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:21.635050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161367a-60f3-45b0-aac5-2a28e804351e service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:21.653580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 710/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:22.456081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e673ad-0545-49d5-99a2-34daa0c2556a None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:22.456638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e673ad-0545-49d5-99a2-34daa0c2556a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:22.456638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e673ad-0545-49d5-99a2-34daa0c2556a None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:22.457899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:22.463986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4314c2-a1bd-4389-910d-9201bce7345b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:22.464686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4314c2-a1bd-4389-910d-9201bce7345b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:22.464781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4314c2-a1bd-4389-910d-9201bce7345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:22.556212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6a4314c2-a1bd-4389-910d-9201bce7345b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:22.557436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6a4314c2-a1bd-4389-910d-9201bce7345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:22.655448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:22.809802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e673ad-0545-49d5-99a2-34daa0c2556a None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:22.812151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b5e673ad-0545-49d5-99a2-34daa0c2556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:22.868232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:22.973087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e673ad-0545-49d5-99a2-34daa0c2556a None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:23.088772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2e522-3e5d-465e-bd84-bdae7908819f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:23.089372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e522-3e5d-465e-bd84-bdae7908819f service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:23.089648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e522-3e5d-465e-bd84-bdae7908819f service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:23.089907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e522-3e5d-465e-bd84-bdae7908819f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:23.092302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-33a2e522-3e5d-465e-bd84-bdae7908819f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:23.099388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:23.188439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2e522-3e5d-465e-bd84-bdae7908819f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:23.190088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2e522-3e5d-465e-bd84-bdae7908819f service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:23.209640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 720/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:24.049056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d24c-bd58-4fe2-a3d9-ef9773ada89a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:24.049617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d24c-bd58-4fe2-a3d9-ef9773ada89a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:24.049617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d24c-bd58-4fe2-a3d9-ef9773ada89a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:24.050956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:24.056844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7310b9-99c8-4781-9fc8-e3e0a879a01c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:24.057286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7310b9-99c8-4781-9fc8-e3e0a879a01c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:24.057395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7310b9-99c8-4781-9fc8-e3e0a879a01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:24.143948 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2a7310b9-99c8-4781-9fc8-e3e0a879a01c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:24.145718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2a7310b9-99c8-4781-9fc8-e3e0a879a01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:24.224687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:24.254951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:24.409063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d24c-bd58-4fe2-a3d9-ef9773ada89a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:24.410646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-edd1d24c-bd58-4fe2-a3d9-ef9773ada89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:24.431663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:24.568203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d24c-bd58-4fe2-a3d9-ef9773ada89a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:24.668982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:24.696564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643f96c-d947-47b4-85dd-73fe4bdb4919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:24.697190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643f96c-d947-47b4-85dd-73fe4bdb4919 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:24.697463 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643f96c-d947-47b4-85dd-73fe4bdb4919 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:24.697733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643f96c-d947-47b4-85dd-73fe4bdb4919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:24.699350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a643f96c-d947-47b4-85dd-73fe4bdb4919 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:24.792955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643f96c-d947-47b4-85dd-73fe4bdb4919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:24.794554 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643f96c-d947-47b4-85dd-73fe4bdb4919 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:24.813869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 713/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:25.646194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5236f-293c-4550-81e6-8bd818f7bbaa None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:25.647122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5236f-293c-4550-81e6-8bd818f7bbaa None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:25.647122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5236f-293c-4550-81e6-8bd818f7bbaa None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:25.649581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:16:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:25.654825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268f9dd-9b48-44e1-bc9c-fb8182fc0c68 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:25.655273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268f9dd-9b48-44e1-bc9c-fb8182fc0c68 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:25.655370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268f9dd-9b48-44e1-bc9c-fb8182fc0c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:25.741550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e268f9dd-9b48-44e1-bc9c-fb8182fc0c68 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:25.742783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e268f9dd-9b48-44e1-bc9c-fb8182fc0c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:25.786320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:25.860591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:26.013523 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5236f-293c-4550-81e6-8bd818f7bbaa None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:26.014955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d8e5236f-293c-4550-81e6-8bd818f7bbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:26.182751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5236f-293c-4550-81e6-8bd818f7bbaa None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:26.244038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:26.307560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4aaeb-cbb4-4a49-a5e4-858b96f2b706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:26.308269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4aaeb-cbb4-4a49-a5e4-858b96f2b706 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:26.308669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4aaeb-cbb4-4a49-a5e4-858b96f2b706 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:26.309068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4aaeb-cbb4-4a49-a5e4-858b96f2b706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:26.311639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-13c4aaeb-cbb4-4a49-a5e4-858b96f2b706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:26.421894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4aaeb-cbb4-4a49-a5e4-858b96f2b706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:26.423515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4aaeb-cbb4-4a49-a5e4-858b96f2b706 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:26.441751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 723/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:27.258058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52b0b-382b-4954-8207-7745c53e71b9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:27.258551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52b0b-382b-4954-8207-7745c53e71b9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:27.258665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52b0b-382b-4954-8207-7745c53e71b9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:27.260029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:27.265356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9db1a-f8d1-4315-a434-8530ad03368c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:27.265787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9db1a-f8d1-4315-a434-8530ad03368c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:27.265899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9db1a-f8d1-4315-a434-8530ad03368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:27.353952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8ec9db1a-f8d1-4315-a434-8530ad03368c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:27.355177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8ec9db1a-f8d1-4315-a434-8530ad03368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:27.357235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:27.461763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:27.618081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e52b0b-382b-4954-8207-7745c53e71b9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:27.620579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-68e52b0b-382b-4954-8207-7745c53e71b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:27.791388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e52b0b-382b-4954-8207-7745c53e71b9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:27.818933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:27.912943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891283b-a134-4c89-a603-ea60bff851ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:27.913705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891283b-a134-4c89-a603-ea60bff851ad service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:27.913980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891283b-a134-4c89-a603-ea60bff851ad service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:27.914251 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891283b-a134-4c89-a603-ea60bff851ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:27.915911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2891283b-a134-4c89-a603-ea60bff851ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:28.008270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891283b-a134-4c89-a603-ea60bff851ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:28.009847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891283b-a134-4c89-a603-ea60bff851ad service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:28.028163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 716/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:29.855908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cd771-7ad8-44f4-a3aa-b52719200c16 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:29.856449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cd771-7ad8-44f4-a3aa-b52719200c16 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:29.856449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cd771-7ad8-44f4-a3aa-b52719200c16 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:29.857820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:29.864520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e722eb2-64ae-4da9-9150-a1424ada3989 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:29.865252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e722eb2-64ae-4da9-9150-a1424ada3989 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:29.865425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e722eb2-64ae-4da9-9150-a1424ada3989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:29.909751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:29.937819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6e722eb2-64ae-4da9-9150-a1424ada3989 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:29.939049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6e722eb2-64ae-4da9-9150-a1424ada3989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:30.047596 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:30.325816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cd771-7ad8-44f4-a3aa-b52719200c16 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:30.327448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-652cd771-7ad8-44f4-a3aa-b52719200c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:30.449135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cd771-7ad8-44f4-a3aa-b52719200c16 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:30.485134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:30.529689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d43772-7b0a-46d9-be8c-385865b9c543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:30.530292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d43772-7b0a-46d9-be8c-385865b9c543 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:30.530570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d43772-7b0a-46d9-be8c-385865b9c543 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:30.530838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d43772-7b0a-46d9-be8c-385865b9c543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:30.532536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-61d43772-7b0a-46d9-be8c-385865b9c543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:30.659691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d43772-7b0a-46d9-be8c-385865b9c543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:30.661183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d43772-7b0a-46d9-be8c-385865b9c543 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:30.686189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 726/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:32.868126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71356dd3-c4ab-425d-a4d5-fa3302f03c7d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:32.868796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71356dd3-c4ab-425d-a4d5-fa3302f03c7d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:32.868796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71356dd3-c4ab-425d-a4d5-fa3302f03c7d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:32.870016 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:16:32.876469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1874cd-84ea-4395-a459-7b77de6c9431 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:32.877186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1874cd-84ea-4395-a459-7b77de6c9431 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:32.877366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1874cd-84ea-4395-a459-7b77de6c9431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:32.955881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-eb1874cd-84ea-4395-a459-7b77de6c9431 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:32.957138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-eb1874cd-84ea-4395-a459-7b77de6c9431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:32.971004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:33.059883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:33.341570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71356dd3-c4ab-425d-a4d5-fa3302f03c7d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:33.343527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-71356dd3-c4ab-425d-a4d5-fa3302f03c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:33.468989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71356dd3-c4ab-425d-a4d5-fa3302f03c7d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:33.483423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:33.555082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc891bfa-124b-40d3-b92f-f1d4334b1c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:33.555744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc891bfa-124b-40d3-b92f-f1d4334b1c43 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:33.556022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc891bfa-124b-40d3-b92f-f1d4334b1c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:33.556291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc891bfa-124b-40d3-b92f-f1d4334b1c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:33.557905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cc891bfa-124b-40d3-b92f-f1d4334b1c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:33.673212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc891bfa-124b-40d3-b92f-f1d4334b1c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:33.674653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc891bfa-124b-40d3-b92f-f1d4334b1c43 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:33.694040 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 719/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:16:35.989557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ed66b-9fa5-4ff4-ab91-14c08006f557 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:35.990469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ed66b-9fa5-4ff4-ab91-14c08006f557 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:35.990469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ed66b-9fa5-4ff4-ab91-14c08006f557 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:35.992662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:36.001308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7b523-8890-4cf6-a3f4-d7b72afed021 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:36.001741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7b523-8890-4cf6-a3f4-d7b72afed021 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:36.001878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7b523-8890-4cf6-a3f4-d7b72afed021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:36.056293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:36.076091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-96a7b523-8890-4cf6-a3f4-d7b72afed021 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:36.077310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-96a7b523-8890-4cf6-a3f4-d7b72afed021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:36.185570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:36.472883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ed66b-9fa5-4ff4-ab91-14c08006f557 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:36.475502 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2c0ed66b-9fa5-4ff4-ab91-14c08006f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:36.592758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ed66b-9fa5-4ff4-ab91-14c08006f557 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:36.634146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:36.669199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8794c-94f7-4e2f-aefd-96cebbe0dc7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:36.669807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8794c-94f7-4e2f-aefd-96cebbe0dc7f service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:36.670076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8794c-94f7-4e2f-aefd-96cebbe0dc7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:36.670328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8794c-94f7-4e2f-aefd-96cebbe0dc7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:36.671982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f1b8794c-94f7-4e2f-aefd-96cebbe0dc7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:36.789890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8794c-94f7-4e2f-aefd-96cebbe0dc7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:36.791302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8794c-94f7-4e2f-aefd-96cebbe0dc7f service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:36.811622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 729/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:38.855994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2606-543a-4712-8cf1-eeab99ddff06 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:38.856912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2606-543a-4712-8cf1-eeab99ddff06 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:38.856912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2606-543a-4712-8cf1-eeab99ddff06 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:38.859062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:38.865553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066290-09bb-4717-98a9-9f869dff0ad5 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:38.866286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066290-09bb-4717-98a9-9f869dff0ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:38.866428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066290-09bb-4717-98a9-9f869dff0ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:38.934950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-be066290-09bb-4717-98a9-9f869dff0ad5 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:38.936185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-be066290-09bb-4717-98a9-9f869dff0ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:38.958945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:39.037969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:39.323867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b2606-543a-4712-8cf1-eeab99ddff06 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:39.326241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-779b2606-543a-4712-8cf1-eeab99ddff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:39.455288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b2606-543a-4712-8cf1-eeab99ddff06 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:39.476786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:39.537339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720392a-052e-417f-abbe-7e151a349f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:39.538212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720392a-052e-417f-abbe-7e151a349f10 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:39.538601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720392a-052e-417f-abbe-7e151a349f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:39.538984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720392a-052e-417f-abbe-7e151a349f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:39.541745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d720392a-052e-417f-abbe-7e151a349f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:39.663019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720392a-052e-417f-abbe-7e151a349f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:39.664622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720392a-052e-417f-abbe-7e151a349f10 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:39.683610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 722/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:41.643294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ada7f-bde0-4494-92e8-eb549d40eb26 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:41.643857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ada7f-bde0-4494-92e8-eb549d40eb26 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:41.643857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ada7f-bde0-4494-92e8-eb549d40eb26 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:41.645212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:41.651958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee0ac-50c4-442f-b3e7-21ac33ceed6f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:41.652398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee0ac-50c4-442f-b3e7-21ac33ceed6f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:41.652528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee0ac-50c4-442f-b3e7-21ac33ceed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:41.732696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:41.737452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4ecee0ac-50c4-442f-b3e7-21ac33ceed6f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:41.740648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4ecee0ac-50c4-442f-b3e7-21ac33ceed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:41.841570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:42.127636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ada7f-bde0-4494-92e8-eb549d40eb26 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:42.130059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4d4ada7f-bde0-4494-92e8-eb549d40eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:42.248357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ada7f-bde0-4494-92e8-eb549d40eb26 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:42.299957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:42.327214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfb24a-cb0e-45ad-8a6a-5170f78418d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:42.327855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfb24a-cb0e-45ad-8a6a-5170f78418d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:42.328131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfb24a-cb0e-45ad-8a6a-5170f78418d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:42.328403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfb24a-cb0e-45ad-8a6a-5170f78418d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:42.329995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f7dfb24a-cb0e-45ad-8a6a-5170f78418d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:42.444553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfb24a-cb0e-45ad-8a6a-5170f78418d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:42.446192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfb24a-cb0e-45ad-8a6a-5170f78418d6 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:42.466385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 732/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:44.402647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115032f-a4e9-473d-8e40-4d8324fa27b6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:44.403580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115032f-a4e9-473d-8e40-4d8324fa27b6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:44.403800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115032f-a4e9-473d-8e40-4d8324fa27b6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:44.405923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:44.411636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e447d04-44b7-484e-b455-1598e1f4aab5 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:44.412080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e447d04-44b7-484e-b455-1598e1f4aab5 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:44.412185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e447d04-44b7-484e-b455-1598e1f4aab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:44.480826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-9e447d04-44b7-484e-b455-1598e1f4aab5 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:44.481938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9e447d04-44b7-484e-b455-1598e1f4aab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:44.511466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:44.588098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:44.879817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115032f-a4e9-473d-8e40-4d8324fa27b6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:44.881444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6115032f-a4e9-473d-8e40-4d8324fa27b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:44.993919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115032f-a4e9-473d-8e40-4d8324fa27b6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:45.035970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:45.094837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161390-b0c2-4880-ad8c-4a9269d9c8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:45.095492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161390-b0c2-4880-ad8c-4a9269d9c8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:45.095763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161390-b0c2-4880-ad8c-4a9269d9c8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:45.096042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161390-b0c2-4880-ad8c-4a9269d9c8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:45.097654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b3161390-b0c2-4880-ad8c-4a9269d9c8e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:45.208683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161390-b0c2-4880-ad8c-4a9269d9c8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:45.210137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161390-b0c2-4880-ad8c-4a9269d9c8e1 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:45.229157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 725/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:16:47.171892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa79f65-1d21-427d-86a8-19c932992a48 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:47.172842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa79f65-1d21-427d-86a8-19c932992a48 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:47.172842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa79f65-1d21-427d-86a8-19c932992a48 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:47.174751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:47.181151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa83039-3448-4f4f-928f-46eedfd2228f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:47.181632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa83039-3448-4f4f-928f-46eedfd2228f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:47.181738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa83039-3448-4f4f-928f-46eedfd2228f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:47.250286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-faa83039-3448-4f4f-928f-46eedfd2228f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:47.251549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-faa83039-3448-4f4f-928f-46eedfd2228f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:47.259707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:47.370269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:47.663859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa79f65-1d21-427d-86a8-19c932992a48 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:47.666274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0aa79f65-1d21-427d-86a8-19c932992a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:47.782047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa79f65-1d21-427d-86a8-19c932992a48 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:47.838148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:47.857891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762098fe-01de-4ba3-aee1-9560651bdd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:47.858498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762098fe-01de-4ba3-aee1-9560651bdd7c service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:47.858806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762098fe-01de-4ba3-aee1-9560651bdd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:47.859079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762098fe-01de-4ba3-aee1-9560651bdd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:47.860716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-762098fe-01de-4ba3-aee1-9560651bdd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:47.971605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762098fe-01de-4ba3-aee1-9560651bdd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:47.972979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762098fe-01de-4ba3-aee1-9560651bdd7c service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:47.991699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 735/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:50.010783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769842-742b-4d1e-84fa-528ebdcda8b2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:50.011412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769842-742b-4d1e-84fa-528ebdcda8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:50.011412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769842-742b-4d1e-84fa-528ebdcda8b2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:50.012724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:50.019128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c3bf4-c7a4-47db-bd50-51b9e6fe57f1 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:50.019939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c3bf4-c7a4-47db-bd50-51b9e6fe57f1 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:50.020091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c3bf4-c7a4-47db-bd50-51b9e6fe57f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:50.101823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4b3c3bf4-c7a4-47db-bd50-51b9e6fe57f1 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:50.103064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4b3c3bf4-c7a4-47db-bd50-51b9e6fe57f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:50.144852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:50.207938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:50.498719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc769842-742b-4d1e-84fa-528ebdcda8b2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:50.501263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dc769842-742b-4d1e-84fa-528ebdcda8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:50.620496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc769842-742b-4d1e-84fa-528ebdcda8b2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:50.658557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:50.702588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1308eb8-0ec1-46d9-a1e8-c13eee137707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:50.703203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308eb8-0ec1-46d9-a1e8-c13eee137707 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:50.703511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308eb8-0ec1-46d9-a1e8-c13eee137707 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:50.703779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308eb8-0ec1-46d9-a1e8-c13eee137707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:50.705396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e1308eb8-0ec1-46d9-a1e8-c13eee137707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:50.828507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1308eb8-0ec1-46d9-a1e8-c13eee137707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:50.829936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1308eb8-0ec1-46d9-a1e8-c13eee137707 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:50.848876 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 728/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:52.738667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ada86-26ee-4c03-afc4-7c174ec0210d None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:52.739302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ada86-26ee-4c03-afc4-7c174ec0210d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:52.739302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ada86-26ee-4c03-afc4-7c174ec0210d None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:52.740611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:52.747164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96813a6e-87a2-4d3a-ac87-c9daa8b55a65 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:52.747646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96813a6e-87a2-4d3a-ac87-c9daa8b55a65 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:52.747818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96813a6e-87a2-4d3a-ac87-c9daa8b55a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:52.821945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-96813a6e-87a2-4d3a-ac87-c9daa8b55a65 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:52.822966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-96813a6e-87a2-4d3a-ac87-c9daa8b55a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:52.841855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:52.930634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:53.212659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ada86-26ee-4c03-afc4-7c174ec0210d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:53.214249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-de3ada86-26ee-4c03-afc4-7c174ec0210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:53.333993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ada86-26ee-4c03-afc4-7c174ec0210d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:53.404023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:53.411205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761a51d-0e22-4bbc-849b-7424fc01275f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:53.411892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761a51d-0e22-4bbc-849b-7424fc01275f service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:53.412168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761a51d-0e22-4bbc-849b-7424fc01275f service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:53.412436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761a51d-0e22-4bbc-849b-7424fc01275f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:53.414037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d761a51d-0e22-4bbc-849b-7424fc01275f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:53.525217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761a51d-0e22-4bbc-849b-7424fc01275f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:53.526583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761a51d-0e22-4bbc-849b-7424fc01275f service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:53.544533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 738/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:16:55.465695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fe51a-d8d8-4626-b7e3-5b2e5f3b4391 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:55.466253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fe51a-d8d8-4626-b7e3-5b2e5f3b4391 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:55.466253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fe51a-d8d8-4626-b7e3-5b2e5f3b4391 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:55.467573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:16:55.474395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ad50-0b6d-495d-a163-0112d7005559 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:55.475120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ad50-0b6d-495d-a163-0112d7005559 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:55.475214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ad50-0b6d-495d-a163-0112d7005559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:55.547939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ede7ad50-0b6d-495d-a163-0112d7005559 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:16:55.549163 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ede7ad50-0b6d-495d-a163-0112d7005559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:55.610195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:55.662007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:16:55.946808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fe51a-d8d8-4626-b7e3-5b2e5f3b4391 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:16:55.948478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f32fe51a-d8d8-4626-b7e3-5b2e5f3b4391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:56.061884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fe51a-d8d8-4626-b7e3-5b2e5f3b4391 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:16:56.120519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:16:56.148172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392de45f-c8a9-4d96-929a-7b5f904daee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:16:56.148785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de45f-c8a9-4d96-929a-7b5f904daee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:16:56.149061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de45f-c8a9-4d96-929a-7b5f904daee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:16:56.149333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de45f-c8a9-4d96-929a-7b5f904daee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:16:56.151018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-392de45f-c8a9-4d96-929a-7b5f904daee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:16:56.266512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392de45f-c8a9-4d96-929a-7b5f904daee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:16:56.267903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392de45f-c8a9-4d96-929a-7b5f904daee7 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:16:56.288339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 731/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:17:05.660096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=22 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:06.284789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=66 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:15.967713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09bdb3-9673-47fd-aa65-cac8a75a304a None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:15.968321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09bdb3-9673-47fd-aa65-cac8a75a304a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:15.968321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09bdb3-9673-47fd-aa65-cac8a75a304a None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:15.969605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 740/1471] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:17:15.976300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2652ff-12ba-4e37-acd5-9c3b0f8435da None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:15.977048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2652ff-12ba-4e37-acd5-9c3b0f8435da None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:15.977048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2652ff-12ba-4e37-acd5-9c3b0f8435da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:16.046932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1c2652ff-12ba-4e37-acd5-9c3b0f8435da None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:17:16.048228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1c2652ff-12ba-4e37-acd5-9c3b0f8435da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:16.162561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 732/1472] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:17:16.474220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd31900-9c85-4ad0-bb8c-007a0400a9b2 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:16.474503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd31900-9c85-4ad0-bb8c-007a0400a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:16.474786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd31900-9c85-4ad0-bb8c-007a0400a9b2 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:16.476181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 741/1473] 10.222.0.39 () {54 vars in 961 bytes} [Sat Sep 3 01:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:17:16.481544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871647-478e-4596-81bb-afc306d03373 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:16.481828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871647-478e-4596-81bb-afc306d03373 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:16.482096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871647-478e-4596-81bb-afc306d03373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:16.570744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2b871647-478e-4596-81bb-afc306d03373 None None] MFA Rules not processed for user `54131719962e4463b0b874916cb40973`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:17:16.572010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b871647-478e-4596-81bb-afc306d03373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:16.594451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:16.655551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 733/1474] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Sep 3 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:17:16.664089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd31900-9c85-4ad0-bb8c-007a0400a9b2 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:17:16.666441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7cd31900-9c85-4ad0-bb8c-007a0400a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:16.772890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd31900-9c85-4ad0-bb8c-007a0400a9b2 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:17:16.852033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d366fe6-5f88-4008-8753-12d29477a561 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54131719962e4463b0b874916cb40973', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:17:16.852640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366fe6-5f88-4008-8753-12d29477a561 service glance] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:16.852919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366fe6-5f88-4008-8753-12d29477a561 service glance] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:16.853170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366fe6-5f88-4008-8753-12d29477a561 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:16.854846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4d366fe6-5f88-4008-8753-12d29477a561 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:16.910018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:16.968109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d366fe6-5f88-4008-8753-12d29477a561 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:17:16.969571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d366fe6-5f88-4008-8753-12d29477a561 service glance] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:17:16.989588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 742/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:17:19.003360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802630e0-5970-422a-9169-3b72a712518b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:19.003945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802630e0-5970-422a-9169-3b72a712518b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:19.003945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802630e0-5970-422a-9169-3b72a712518b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:19.005306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 734/1476] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:17:19.011978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5312d4-c1e1-4f14-923c-718b7b32b15f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:19.012539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5312d4-c1e1-4f14-923c-718b7b32b15f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:19.012647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5312d4-c1e1-4f14-923c-718b7b32b15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:19.102864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3b5312d4-c1e1-4f14-923c-718b7b32b15f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:17:19.104145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3b5312d4-c1e1-4f14-923c-718b7b32b15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:19.216083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 743/1477] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:17:19.501218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802630e0-5970-422a-9169-3b72a712518b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:17:19.502699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-802630e0-5970-422a-9169-3b72a712518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:19.642292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802630e0-5970-422a-9169-3b72a712518b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:17:19.698688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:19.748883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12bdcb-9cd5-4b7c-96fa-bea5ad0d8a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:17:19.749493 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12bdcb-9cd5-4b7c-96fa-bea5ad0d8a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:19.749762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12bdcb-9cd5-4b7c-96fa-bea5ad0d8a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:19.750029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12bdcb-9cd5-4b7c-96fa-bea5ad0d8a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:19.750664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12bdcb-9cd5-4b7c-96fa-bea5ad0d8a43 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:17:19.752586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-1e12bdcb-9cd5-4b7c-96fa-bea5ad0d8a43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:17:19.752586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 03 01:17:19.752586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: Sep 03 01:17:19.753667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12bdcb-9cd5-4b7c-96fa-bea5ad0d8a43 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:17:19.772392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 735/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Sep 3 01:17:19 2022] GET /identity/v3/projects => generated 2553 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:17:21.711189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badccf55-a2db-4f75-939c-6f9c3538e096 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:21.712180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badccf55-a2db-4f75-939c-6f9c3538e096 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:21.712180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badccf55-a2db-4f75-939c-6f9c3538e096 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:21.714378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 744/1479] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:17:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:17:21.720159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5d1ad-4228-4113-afa3-c3a4f986ae65 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:21.720561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5d1ad-4228-4113-afa3-c3a4f986ae65 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:21.720715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5d1ad-4228-4113-afa3-c3a4f986ae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:21.795128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-21c5d1ad-4228-4113-afa3-c3a4f986ae65 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:17:21.796401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-21c5d1ad-4228-4113-afa3-c3a4f986ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:21.906838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 736/1480] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:17:22.205706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badccf55-a2db-4f75-939c-6f9c3538e096 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:17:22.207669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-badccf55-a2db-4f75-939c-6f9c3538e096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:22.218793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:22.375097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badccf55-a2db-4f75-939c-6f9c3538e096 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:17:22.466436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:22.501741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7f8ee-c1c3-4e4e-8d02-ee13d8738c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:17:22.502359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7f8ee-c1c3-4e4e-8d02-ee13d8738c21 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:22.502612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7f8ee-c1c3-4e4e-8d02-ee13d8738c21 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:22.502878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7f8ee-c1c3-4e4e-8d02-ee13d8738c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:22.504514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b7e7f8ee-c1c3-4e4e-8d02-ee13d8738c21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:22.601693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7f8ee-c1c3-4e4e-8d02-ee13d8738c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:17:22.603608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7f8ee-c1c3-4e4e-8d02-ee13d8738c21 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:17:22.623748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 745/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:17:24.730803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed4c20-fac8-4f14-94f4-038b5bd248e4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:24.731377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed4c20-fac8-4f14-94f4-038b5bd248e4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:24.731377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed4c20-fac8-4f14-94f4-038b5bd248e4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:24.732661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 737/1482] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:17:24.738782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100deaa-c07d-4e4f-b01a-058fda8ae6c8 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:24.739234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100deaa-c07d-4e4f-b01a-058fda8ae6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:24.739391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100deaa-c07d-4e4f-b01a-058fda8ae6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:24.814165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6100deaa-c07d-4e4f-b01a-058fda8ae6c8 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:17:24.815432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6100deaa-c07d-4e4f-b01a-058fda8ae6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:24.872196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:24.931933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 746/1483] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:17:25.222504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed4c20-fac8-4f14-94f4-038b5bd248e4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:17:25.224096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aeed4c20-fac8-4f14-94f4-038b5bd248e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:25.252316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:25.337565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed4c20-fac8-4f14-94f4-038b5bd248e4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:17:25.416847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee94363-1f58-4bbf-99a7-84b7fed46cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:17:25.417472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee94363-1f58-4bbf-99a7-84b7fed46cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:25.417749 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee94363-1f58-4bbf-99a7-84b7fed46cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:25.418025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee94363-1f58-4bbf-99a7-84b7fed46cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:25.419650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7ee94363-1f58-4bbf-99a7-84b7fed46cf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:25.500584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:25.539708 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee94363-1f58-4bbf-99a7-84b7fed46cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:17:25.541139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee94363-1f58-4bbf-99a7-84b7fed46cf7 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:17:25.560980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 738/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:17:27.519939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfdd0-31d2-4d04-a0d3-502214eab74d None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:27.520811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfdd0-31d2-4d04-a0d3-502214eab74d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:27.520811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfdd0-31d2-4d04-a0d3-502214eab74d None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:27.522847 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 747/1485] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:17:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:17:27.528561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452273db-0db6-4fbd-bfc0-0a913f78fd18 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:27.529010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452273db-0db6-4fbd-bfc0-0a913f78fd18 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:27.529104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452273db-0db6-4fbd-bfc0-0a913f78fd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:27.718378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-452273db-0db6-4fbd-bfc0-0a913f78fd18 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:17:27.719662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-452273db-0db6-4fbd-bfc0-0a913f78fd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:27.821067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 739/1486] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:17:28.122348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfdd0-31d2-4d04-a0d3-502214eab74d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:17:28.123937 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-59ecfdd0-31d2-4d04-a0d3-502214eab74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:28.236294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfdd0-31d2-4d04-a0d3-502214eab74d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:17:28.312800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:28.318651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228923d7-acb8-456d-9c00-0ab9296ac151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:17:28.319806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228923d7-acb8-456d-9c00-0ab9296ac151 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:28.320131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228923d7-acb8-456d-9c00-0ab9296ac151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:28.320865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228923d7-acb8-456d-9c00-0ab9296ac151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:28.325115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-228923d7-acb8-456d-9c00-0ab9296ac151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:28.447488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228923d7-acb8-456d-9c00-0ab9296ac151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:17:28.448882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228923d7-acb8-456d-9c00-0ab9296ac151 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:17:28.468768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 748/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:17:30.474629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048394f-ece8-4342-88ea-288174c6208a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:30.475553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048394f-ece8-4342-88ea-288174c6208a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:30.475553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048394f-ece8-4342-88ea-288174c6208a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:30.477641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 740/1488] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:17:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:17:30.486687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea693a18-4ae7-4398-91b9-e329dc787677 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:30.487120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea693a18-4ae7-4398-91b9-e329dc787677 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:30.487247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea693a18-4ae7-4398-91b9-e329dc787677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:30.560600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ea693a18-4ae7-4398-91b9-e329dc787677 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:17:30.561811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ea693a18-4ae7-4398-91b9-e329dc787677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:30.618734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:30.677073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 749/1489] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:17:31.004596 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048394f-ece8-4342-88ea-288174c6208a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:17:31.008637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7048394f-ece8-4342-88ea-288174c6208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:31.063585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:31.156791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048394f-ece8-4342-88ea-288174c6208a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:17:31.244972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d61479-226a-45b2-927c-cec609755312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:17:31.245521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d61479-226a-45b2-927c-cec609755312 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:31.245847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d61479-226a-45b2-927c-cec609755312 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:31.246145 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d61479-226a-45b2-927c-cec609755312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:31.247784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-73d61479-226a-45b2-927c-cec609755312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:31.352214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:31.388082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d61479-226a-45b2-927c-cec609755312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:17:31.390153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d61479-226a-45b2-927c-cec609755312 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:17:31.414585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 741/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:17:33.541347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4be88-d56e-412f-9197-fa6d07b91e21 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:33.542035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4be88-d56e-412f-9197-fa6d07b91e21 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:33.542035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4be88-d56e-412f-9197-fa6d07b91e21 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:33.543283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 750/1491] 10.222.0.39 () {54 vars in 927 bytes} [Sat Sep 3 01:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:17:33.549844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207464ab-b6fa-4a5d-b959-211ff2660805 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:33.550659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207464ab-b6fa-4a5d-b959-211ff2660805 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:33.550767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207464ab-b6fa-4a5d-b959-211ff2660805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:33.629624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-207464ab-b6fa-4a5d-b959-211ff2660805 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:17:33.631520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-207464ab-b6fa-4a5d-b959-211ff2660805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:33.738349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 742/1492] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Sep 3 01:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:17:34.035299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4be88-d56e-412f-9197-fa6d07b91e21 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:17:34.037853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b5b4be88-d56e-412f-9197-fa6d07b91e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:34.148403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4be88-d56e-412f-9197-fa6d07b91e21 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:17:34.228365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbd764-3738-4898-a9ff-d82040ba34bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:17:34.228976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd764-3738-4898-a9ff-d82040ba34bb service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:17:34.229250 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd764-3738-4898-a9ff-d82040ba34bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:17:34.229511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd764-3738-4898-a9ff-d82040ba34bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:17:34.231288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3bdbd764-3738-4898-a9ff-d82040ba34bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:17:34.241351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:34.350443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbd764-3738-4898-a9ff-d82040ba34bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:17:34.351918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbd764-3738-4898-a9ff-d82040ba34bb service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:17:34.371918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 751/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:17:43.736099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=82 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:17:44.369237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=50 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:55.097583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd89e35-c4ab-4974-80ce-6fe1fcf10c75 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:55.098147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd89e35-c4ab-4974-80ce-6fe1fcf10c75 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:55.098147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd89e35-c4ab-4974-80ce-6fe1fcf10c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:55.180803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ddd89e35-c4ab-4974-80ce-6fe1fcf10c75 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:18:55.182077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ddd89e35-c4ab-4974-80ce-6fe1fcf10c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:55.282335 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 743/1494] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:18:55.290432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330bc2f-a2de-40d8-a91a-06609f5f121d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:55.290949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330bc2f-a2de-40d8-a91a-06609f5f121d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:55.290949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330bc2f-a2de-40d8-a91a-06609f5f121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:55.374248 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e330bc2f-a2de-40d8-a91a-06609f5f121d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:18:55.375494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e330bc2f-a2de-40d8-a91a-06609f5f121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:55.485694 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 752/1495] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:18:55.492991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd89e35-c4ab-4974-80ce-6fe1fcf10c75 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:18:55.496305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ddd89e35-c4ab-4974-80ce-6fe1fcf10c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:55.509512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd89e35-c4ab-4974-80ce-6fe1fcf10c75 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:18:55.580389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:55.616899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:18:55.617508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:55.617779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:55.618041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:55.618677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:18:55.618972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:18:55.620025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:18:55.620025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 03 01:18:55.620025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: Sep 03 01:18:55.621065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:18:55.632790 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 744/1496] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:18:55.641682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330bc2f-a2de-40d8-a91a-06609f5f121d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:18:55.651800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330bc2f-a2de-40d8-a91a-06609f5f121d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:18:55.716202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:55.751679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ba491-946a-4f01-9107-5287a1d3c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:18:55.752287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ba491-946a-4f01-9107-5287a1d3c872 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:55.752563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ba491-946a-4f01-9107-5287a1d3c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:55.752828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ba491-946a-4f01-9107-5287a1d3c872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:55.753472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ba491-946a-4f01-9107-5287a1d3c872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:18:55.755210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: WARNING py.warnings [None req-ff1ba491-946a-4f01-9107-5287a1d3c872 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:18:55.755210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: warnings.warn(msg) Sep 03 01:18:55.755210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: Sep 03 01:18:55.756424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ba491-946a-4f01-9107-5287a1d3c872 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:18:55.814285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 753/1497] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:18:55 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:18:55.818621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:18:55.820252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:55.854484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c592a-a2a3-4b29-8029-5b3ec2f1c888 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:18:55.950474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef09af-c6b4-4368-8cd8-af65b2ce6413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:18:55.951072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef09af-c6b4-4368-8cd8-af65b2ce6413 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:55.951373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef09af-c6b4-4368-8cd8-af65b2ce6413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:55.951637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef09af-c6b4-4368-8cd8-af65b2ce6413 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:55.952265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef09af-c6b4-4368-8cd8-af65b2ce6413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:18:55.953496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-57ef09af-c6b4-4368-8cd8-af65b2ce6413 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:18:55.953496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 03 01:18:55.953496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: Sep 03 01:18:55.954687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef09af-c6b4-4368-8cd8-af65b2ce6413 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:18:56.008818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 745/1498] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:18:55 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:18:56.014807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ba491-946a-4f01-9107-5287a1d3c872 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:18:56.016961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ff1ba491-946a-4f01-9107-5287a1d3c872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:56.090242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ba491-946a-4f01-9107-5287a1d3c872 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:18:56.177251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:56.192790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a149f7-524c-4d5d-baa2-032f788a231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:18:56.193415 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a149f7-524c-4d5d-baa2-032f788a231a admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:56.193711 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a149f7-524c-4d5d-baa2-032f788a231a admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:56.194009 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a149f7-524c-4d5d-baa2-032f788a231a admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:56.194658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a149f7-524c-4d5d-baa2-032f788a231a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:18:56.195739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: WARNING py.warnings [None req-59a149f7-524c-4d5d-baa2-032f788a231a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:18:56.195739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: warnings.warn(msg) Sep 03 01:18:56.195739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: Sep 03 01:18:56.196665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a149f7-524c-4d5d-baa2-032f788a231a admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:18:56.210365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 754/1499] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:18:56.214655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef09af-c6b4-4368-8cd8-af65b2ce6413 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:18:56.216204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-57ef09af-c6b4-4368-8cd8-af65b2ce6413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:56.228062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef09af-c6b4-4368-8cd8-af65b2ce6413 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:18:56.257172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:56.338431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d318d-9d17-4d85-882b-190c36c98279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:18:56.339312 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d318d-9d17-4d85-882b-190c36c98279 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:56.339734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d318d-9d17-4d85-882b-190c36c98279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:56.340119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d318d-9d17-4d85-882b-190c36c98279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:56.340861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d318d-9d17-4d85-882b-190c36c98279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:18:56.342364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-4d6d318d-9d17-4d85-882b-190c36c98279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:18:56.342364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 03 01:18:56.342364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: Sep 03 01:18:56.343849 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d318d-9d17-4d85-882b-190c36c98279 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:18:56.356980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 746/1500] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:18:56.361494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a149f7-524c-4d5d-baa2-032f788a231a admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:18:56.363060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-59a149f7-524c-4d5d-baa2-032f788a231a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:56.396706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a149f7-524c-4d5d-baa2-032f788a231a admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:18:56.495163 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af1c7-aa05-4453-96b7-288d32eb2d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:18:56.495776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af1c7-aa05-4453-96b7-288d32eb2d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:56.496053 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af1c7-aa05-4453-96b7-288d32eb2d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:56.496323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af1c7-aa05-4453-96b7-288d32eb2d4e admin admin] PATH_INFO: `/v3/projects/954e197f209d4c6088438d0415b2f340/users/d0a017a06bb249beb05179ddfb52fe8a/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:56.518806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289af1c7-aa05-4453-96b7-288d32eb2d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=954e197f209d4c6088438d0415b2f340, user_id=d0a017a06bb249beb05179ddfb52fe8a, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:18:56.519871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: WARNING py.warnings [None req-289af1c7-aa05-4453-96b7-288d32eb2d4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:18:56.519871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: warnings.warn(msg) Sep 03 01:18:56.519871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: Sep 03 01:18:56.521797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289af1c7-aa05-4453-96b7-288d32eb2d4e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:18:56.549517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 755/1501] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:18:56 2022] PUT /identity/v3/projects/954e197f209d4c6088438d0415b2f340/users/d0a017a06bb249beb05179ddfb52fe8a/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:18:56.562166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8b667-0446-471c-b186-492d515989a3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:56.562452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8b667-0446-471c-b186-492d515989a3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:56.562928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8b667-0446-471c-b186-492d515989a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:56.627328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c6a8b667-0446-471c-b186-492d515989a3 None None] MFA Rules not processed for user `d0a017a06bb249beb05179ddfb52fe8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:18:56.629124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c6a8b667-0446-471c-b186-492d515989a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:56.714736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 747/1502] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:18:56.730067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5664fa-112c-4d0e-b9b3-acb4d6fcbab4 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:56.730390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5664fa-112c-4d0e-b9b3-acb4d6fcbab4 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:56.730664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5664fa-112c-4d0e-b9b3-acb4d6fcbab4 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:56.732729 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 756/1503] 10.222.0.39 () {54 vars in 964 bytes} [Sat Sep 3 01:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:18:56.738159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0be09c-71e0-428d-ab2c-e0dd3d910b9e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:56.738443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0be09c-71e0-428d-ab2c-e0dd3d910b9e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:56.738711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0be09c-71e0-428d-ab2c-e0dd3d910b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:56.771853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:56.825538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bd0be09c-71e0-428d-ab2c-e0dd3d910b9e None None] MFA Rules not processed for user `248ccaa14fce4726826a16c4d3e6ca54`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:18:56.826793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bd0be09c-71e0-428d-ab2c-e0dd3d910b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:56.912927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 748/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Sat Sep 3 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:18:56.921072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5664fa-112c-4d0e-b9b3-acb4d6fcbab4 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:18:56.922647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1f5664fa-112c-4d0e-b9b3-acb4d6fcbab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:56.975727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:57.038822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5664fa-112c-4d0e-b9b3-acb4d6fcbab4 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:18:57.133270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bb536-f7f4-4dba-8ce5-444e8e6038e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:18:57.134015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bb536-f7f4-4dba-8ce5-444e8e6038e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:57.134292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bb536-f7f4-4dba-8ce5-444e8e6038e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:57.134558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bb536-f7f4-4dba-8ce5-444e8e6038e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:57.136193 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0d6bb536-f7f4-4dba-8ce5-444e8e6038e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:57.247064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bb536-f7f4-4dba-8ce5-444e8e6038e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:18:57.248507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bb536-f7f4-4dba-8ce5-444e8e6038e2 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:18:57.252734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:57.268911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 757/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:18:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:18:57.316221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c112d-75af-4710-aa4a-d0dbad4b8a5d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:57.316657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c112d-75af-4710-aa4a-d0dbad4b8a5d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:57.316776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c112d-75af-4710-aa4a-d0dbad4b8a5d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:57.318048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 749/1506] 10.222.0.39 () {52 vars in 830 bytes} [Sat Sep 3 01:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:18:57.321898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bb536-f7f4-4dba-8ce5-444e8e6038e2 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:18:57.323185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0d6bb536-f7f4-4dba-8ce5-444e8e6038e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:57.426902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bb536-f7f4-4dba-8ce5-444e8e6038e2 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:18:57.523051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:18:57.523707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:57.523981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:57.524244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] PATH_INFO: `/v3/users/d0a017a06bb249beb05179ddfb52fe8a` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:57.536988 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a017a06bb249beb05179ddfb52fe8a)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:18:57.538034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: WARNING py.warnings [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:18:57.538034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: warnings.warn(msg) Sep 03 01:18:57.538034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: Sep 03 01:18:57.539341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:18:57.550469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:57.611843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a017a06bb249beb05179ddfb52fe8a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:18:57.636198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a017a06bb249beb05179ddfb52fe8a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:18:57.650871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a017a06bb249beb05179ddfb52fe8a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:18:57.651484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a017a06bb249beb05179ddfb52fe8a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:18:57.651908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a017a06bb249beb05179ddfb52fe8a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:18:57.669888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 758/1507] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:18:57 2022] DELETE /identity/v3/users/d0a017a06bb249beb05179ddfb52fe8a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:18:57.674612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4136509-3690-4a5b-ab52-544e0abbc2a0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:57.674933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4136509-3690-4a5b-ab52-544e0abbc2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:57.675241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4136509-3690-4a5b-ab52-544e0abbc2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:57.731810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b4136509-3690-4a5b-ab52-544e0abbc2a0 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:18:57.733005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b4136509-3690-4a5b-ab52-544e0abbc2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:57.811316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:57.825095 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 750/1508] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:18:57.838168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:18:57.840181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:57.951956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0177a-9d32-442c-a57c-4db6068894c0 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:18:58.011442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:18:58.033015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa54a7-0f23-41a6-ba59-70e2f2885705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:18:58.033626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa54a7-0f23-41a6-ba59-70e2f2885705 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:58.033903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa54a7-0f23-41a6-ba59-70e2f2885705 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:58.034169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa54a7-0f23-41a6-ba59-70e2f2885705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:58.035793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5eaa54a7-0f23-41a6-ba59-70e2f2885705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:58.158309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa54a7-0f23-41a6-ba59-70e2f2885705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:18:58.159814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa54a7-0f23-41a6-ba59-70e2f2885705 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:18:58.179768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 759/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:18:58.512843 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4136509-3690-4a5b-ab52-544e0abbc2a0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:18:58.514118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b4136509-3690-4a5b-ab52-544e0abbc2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:18:58.525681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4136509-3690-4a5b-ab52-544e0abbc2a0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:18:58.627627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:18:58.628255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:18:58.628526 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:18:58.628793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] PATH_INFO: `/v3/projects/954e197f209d4c6088438d0415b2f340` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:18:58.638717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=954e197f209d4c6088438d0415b2f340)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:18:58.639773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:18:58.639773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 03 01:18:58.639773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: Sep 03 01:18:58.640958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:18:58.707596 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954e197f209d4c6088438d0415b2f340', 'request_id': 'req-6b630391-738f-4a3f-bcef-d2667e8e13b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:18:58.718247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954e197f209d4c6088438d0415b2f340', 'request_id': 'req-6b630391-738f-4a3f-bcef-d2667e8e13b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:18:58.732329 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954e197f209d4c6088438d0415b2f340', 'request_id': 'req-6b630391-738f-4a3f-bcef-d2667e8e13b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:18:58.758428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] The token cache is being invalidate because project 954e197f209d4c6088438d0415b2f340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:18:58.758688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:18:58.759240 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b630391-738f-4a3f-bcef-d2667e8e13b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:18:58.760577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 751/1510] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:18:58 2022] DELETE /identity/v3/projects/954e197f209d4c6088438d0415b2f340 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:19:08.177277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=62 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:19:08.755960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:20:28.549933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508e27-5b31-4bb9-b757-ed64a0970eec None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:28.550536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508e27-5b31-4bb9-b757-ed64a0970eec None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:28.550536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508e27-5b31-4bb9-b757-ed64a0970eec None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:28.551809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:20:28.557793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fff21e-f6b4-4b2d-a81c-3e8fd28aecb9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:28.558301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fff21e-f6b4-4b2d-a81c-3e8fd28aecb9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:28.558405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fff21e-f6b4-4b2d-a81c-3e8fd28aecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:28.646152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-29fff21e-f6b4-4b2d-a81c-3e8fd28aecb9 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:20:28.647401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-29fff21e-f6b4-4b2d-a81c-3e8fd28aecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:28.765645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:20:28.920518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96508e27-5b31-4bb9-b757-ed64a0970eec None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:20:28.924285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-96508e27-5b31-4bb9-b757-ed64a0970eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:29.057461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96508e27-5b31-4bb9-b757-ed64a0970eec None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:20:29.067077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f19a72-f11c-4a89-a48c-789cc7d2b3bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:20:29.068035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f19a72-f11c-4a89-a48c-789cc7d2b3bd service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:29.068454 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f19a72-f11c-4a89-a48c-789cc7d2b3bd service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:29.068853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f19a72-f11c-4a89-a48c-789cc7d2b3bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:29.080104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f19a72-f11c-4a89-a48c-789cc7d2b3bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:20:29.081716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f19a72-f11c-4a89-a48c-789cc7d2b3bd service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:20:29.091447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 761/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:20:29.927633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef28e-62d3-49e3-b161-83a6e3813f2a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:29.928324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef28e-62d3-49e3-b161-83a6e3813f2a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:29.928324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef28e-62d3-49e3-b161-83a6e3813f2a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:29.929541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:20:29.935909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21fd2e-3807-4bc5-8d3b-fab2b3399427 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:29.936606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21fd2e-3807-4bc5-8d3b-fab2b3399427 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:29.936799 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21fd2e-3807-4bc5-8d3b-fab2b3399427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:29.963906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ed21fd2e-3807-4bc5-8d3b-fab2b3399427 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:20:29.965140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ed21fd2e-3807-4bc5-8d3b-fab2b3399427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:29.974838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:20:30.136653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef28e-62d3-49e3-b161-83a6e3813f2a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:20:30.159632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef28e-62d3-49e3-b161-83a6e3813f2a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:20:30.166867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad89eb3-4a28-4283-952e-9a043dbb3da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:20:30.167498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89eb3-4a28-4283-952e-9a043dbb3da4 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:30.167780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89eb3-4a28-4283-952e-9a043dbb3da4 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:30.168049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89eb3-4a28-4283-952e-9a043dbb3da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:30.177086 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad89eb3-4a28-4283-952e-9a043dbb3da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:20:30.178905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad89eb3-4a28-4283-952e-9a043dbb3da4 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:20:30.189856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 754/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:20:30.774164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca80c3-9a1f-4829-a81c-6e270fd690b9 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:30.774475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca80c3-9a1f-4829-a81c-6e270fd690b9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:30.774699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca80c3-9a1f-4829-a81c-6e270fd690b9 None None] PATH_INFO: `/v3` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:30.776033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 763/1517] 10.222.0.27 () {54 vars in 925 bytes} [Sat Sep 3 01:20:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:20:30.782621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249758-7414-4327-8064-ea37fe379f6f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:30.782902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249758-7414-4327-8064-ea37fe379f6f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:30.783166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249758-7414-4327-8064-ea37fe379f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:30.854016 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2a249758-7414-4327-8064-ea37fe379f6f None None] MFA Rules not processed for user `bac171ccd62b4c268e79a318478414ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:20:30.855223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2a249758-7414-4327-8064-ea37fe379f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:30.873208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:20:30.929064 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 755/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Sat Sep 3 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:20:34.812535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241a194-7ab7-434f-a605-94c0f3fad332 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:34.813407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241a194-7ab7-434f-a605-94c0f3fad332 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:34.813407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241a194-7ab7-434f-a605-94c0f3fad332 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:34.815305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 764/1519] 10.222.0.39 () {54 vars in 961 bytes} [Sat Sep 3 01:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:20:34.823536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476212-c64e-4e77-a104-a00703fdb5eb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:34.824266 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476212-c64e-4e77-a104-a00703fdb5eb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:34.824393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476212-c64e-4e77-a104-a00703fdb5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:34.852496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-15476212-c64e-4e77-a104-a00703fdb5eb None None] MFA Rules not processed for user `bac171ccd62b4c268e79a318478414ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:20:34.854069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-15476212-c64e-4e77-a104-a00703fdb5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:34.867277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 756/1520] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Sep 3 01:20:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:20:34.877569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241a194-7ab7-434f-a605-94c0f3fad332 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:20:34.900689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241a194-7ab7-434f-a605-94c0f3fad332 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:20:34.907284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfcf53-d72b-43e1-8e1f-b35e926fc257 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:20:34.907952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfcf53-d72b-43e1-8e1f-b35e926fc257 service placement] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:34.908357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfcf53-d72b-43e1-8e1f-b35e926fc257 service placement] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:34.908628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfcf53-d72b-43e1-8e1f-b35e926fc257 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:34.929476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfcf53-d72b-43e1-8e1f-b35e926fc257 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:20:34.931123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfcf53-d72b-43e1-8e1f-b35e926fc257 service placement] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:20:34.945428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 765/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:20:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:20:41.436461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318154b-8c31-4401-a9f1-b15a8e70d61d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:41.437170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318154b-8c31-4401-a9f1-b15a8e70d61d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:41.437170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318154b-8c31-4401-a9f1-b15a8e70d61d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:41.438446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:20:41.444468 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e51d6d-5132-4429-8391-764b93fe3d4a None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:41.445274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e51d6d-5132-4429-8391-764b93fe3d4a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:41.445454 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e51d6d-5132-4429-8391-764b93fe3d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:41.477541 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-d5e51d6d-5132-4429-8391-764b93fe3d4a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:20:41.479601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d5e51d6d-5132-4429-8391-764b93fe3d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:41.491966 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:20:41.651607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318154b-8c31-4401-a9f1-b15a8e70d61d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:20:41.668288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318154b-8c31-4401-a9f1-b15a8e70d61d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:20:41.674897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd60f78-3215-46ec-b0ab-1ad08094875c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:20:41.675646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd60f78-3215-46ec-b0ab-1ad08094875c service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:41.675972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd60f78-3215-46ec-b0ab-1ad08094875c service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:41.676332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd60f78-3215-46ec-b0ab-1ad08094875c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:41.688794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd60f78-3215-46ec-b0ab-1ad08094875c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:20:41.690306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd60f78-3215-46ec-b0ab-1ad08094875c service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:20:41.700275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 758/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:20:42.526490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e177f-aa3d-41b3-8cba-ec789dd3dad1 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:42.527034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e177f-aa3d-41b3-8cba-ec789dd3dad1 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:42.527034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e177f-aa3d-41b3-8cba-ec789dd3dad1 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:42.529141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 01:20:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:20:42.537175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52795472-7b3d-453a-9f7b-f64aa3994607 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:42.537595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52795472-7b3d-453a-9f7b-f64aa3994607 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:42.537762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52795472-7b3d-453a-9f7b-f64aa3994607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:42.563115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-52795472-7b3d-453a-9f7b-f64aa3994607 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:20:42.564371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-52795472-7b3d-453a-9f7b-f64aa3994607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:42.573845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:20:42.730887 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e177f-aa3d-41b3-8cba-ec789dd3dad1 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:20:42.749889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e177f-aa3d-41b3-8cba-ec789dd3dad1 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:20:42.756927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574a61f-e9f5-4b22-850f-160f6566092d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:20:42.757520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574a61f-e9f5-4b22-850f-160f6566092d service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:42.757798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574a61f-e9f5-4b22-850f-160f6566092d service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:42.758069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574a61f-e9f5-4b22-850f-160f6566092d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:42.766833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574a61f-e9f5-4b22-850f-160f6566092d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:20:42.768447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574a61f-e9f5-4b22-850f-160f6566092d service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:20:42.778299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 768/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:20:46.518480 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3da330-cfaa-4627-acac-9673c4aa82cb None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:46.519023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3da330-cfaa-4627-acac-9673c4aa82cb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:46.519023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3da330-cfaa-4627-acac-9673c4aa82cb None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:46.520323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:20:46.526693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f136f9f-2481-496b-8356-e6826c657a0a None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:46.527441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f136f9f-2481-496b-8356-e6826c657a0a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:46.527739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f136f9f-2481-496b-8356-e6826c657a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:46.555689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0f136f9f-2481-496b-8356-e6826c657a0a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:20:46.556894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0f136f9f-2481-496b-8356-e6826c657a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:46.565869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:20:46.849100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3da330-cfaa-4627-acac-9673c4aa82cb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:20:46.851124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5d3da330-cfaa-4627-acac-9673c4aa82cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:46.934723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3da330-cfaa-4627-acac-9673c4aa82cb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:20:46.939228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73f8f9-062d-4260-ac53-c3b7496e16f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:20:46.939871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73f8f9-062d-4260-ac53-c3b7496e16f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:46.940150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73f8f9-062d-4260-ac53-c3b7496e16f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:46.940424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73f8f9-062d-4260-ac53-c3b7496e16f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:46.949753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73f8f9-062d-4260-ac53-c3b7496e16f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:20:46.951184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73f8f9-062d-4260-ac53-c3b7496e16f5 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:20:46.960920 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 761/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:20:48.846217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d4b34-fdd7-42b8-a147-52071fdab5d9 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:48.846860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d4b34-fdd7-42b8-a147-52071fdab5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:48.846860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d4b34-fdd7-42b8-a147-52071fdab5d9 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:48.848157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:20:48.856369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935fad9-feac-43b5-ad48-4fb21ffe7b7d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:48.857099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935fad9-feac-43b5-ad48-4fb21ffe7b7d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:48.857277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935fad9-feac-43b5-ad48-4fb21ffe7b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:48.880747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3935fad9-feac-43b5-ad48-4fb21ffe7b7d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:20:48.881947 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3935fad9-feac-43b5-ad48-4fb21ffe7b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:48.891111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:20:49.175883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d4b34-fdd7-42b8-a147-52071fdab5d9 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:20:49.190500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d4b34-fdd7-42b8-a147-52071fdab5d9 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:20:49.194925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbfd47-c247-4a90-ab4e-28c12618d464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:20:49.195585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbfd47-c247-4a90-ab4e-28c12618d464 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:49.195865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbfd47-c247-4a90-ab4e-28c12618d464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:49.196137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbfd47-c247-4a90-ab4e-28c12618d464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:49.206729 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbfd47-c247-4a90-ab4e-28c12618d464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:20:49.208224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbfd47-c247-4a90-ab4e-28c12618d464 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:20:49.218147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 771/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:20:52.575437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc01983-793d-413d-8f21-09d25b72a8df None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:52.576000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc01983-793d-413d-8f21-09d25b72a8df None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:52.576000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc01983-793d-413d-8f21-09d25b72a8df None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:52.577243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:20:52.582948 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04670ae-bdce-45aa-8dc7-3e6e4bada9cd None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:52.583515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04670ae-bdce-45aa-8dc7-3e6e4bada9cd None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:52.583515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04670ae-bdce-45aa-8dc7-3e6e4bada9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:52.604802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a04670ae-bdce-45aa-8dc7-3e6e4bada9cd None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:20:52.606028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a04670ae-bdce-45aa-8dc7-3e6e4bada9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:52.615236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:20:53.166894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc01983-793d-413d-8f21-09d25b72a8df None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:20:53.170180 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7dc01983-793d-413d-8f21-09d25b72a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:53.238665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:20:53.254020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc01983-793d-413d-8f21-09d25b72a8df None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:20:53.258893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051f313-2a42-422f-8256-50c379335f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:20:53.259576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051f313-2a42-422f-8256-50c379335f05 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:53.259848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051f313-2a42-422f-8256-50c379335f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:53.260114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051f313-2a42-422f-8256-50c379335f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:53.269871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051f313-2a42-422f-8256-50c379335f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:20:53.271330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051f313-2a42-422f-8256-50c379335f05 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:20:53.280786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 764/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:20:55.203179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01490779-762a-46ca-a542-9827f25d5f82 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:55.203747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01490779-762a-46ca-a542-9827f25d5f82 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:55.203747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01490779-762a-46ca-a542-9827f25d5f82 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:55.205162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 01:20:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:20:55.210460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf88f81-0d49-448a-8d1c-8b1fba4a06bf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:55.210930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf88f81-0d49-448a-8d1c-8b1fba4a06bf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:55.211035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf88f81-0d49-448a-8d1c-8b1fba4a06bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:55.232145 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aaf88f81-0d49-448a-8d1c-8b1fba4a06bf None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:20:55.233363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aaf88f81-0d49-448a-8d1c-8b1fba4a06bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:55.243005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:20:55.790889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01490779-762a-46ca-a542-9827f25d5f82 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:20:55.794138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-01490779-762a-46ca-a542-9827f25d5f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:20:55.809823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01490779-762a-46ca-a542-9827f25d5f82 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:20:55.814281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f646a4-d7bd-472a-9ea7-b413ea800a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:20:55.814879 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f646a4-d7bd-472a-9ea7-b413ea800a59 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:20:55.815159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f646a4-d7bd-472a-9ea7-b413ea800a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:20:55.815449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f646a4-d7bd-472a-9ea7-b413ea800a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:20:55.825423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f646a4-d7bd-472a-9ea7-b413ea800a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:20:55.826883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f646a4-d7bd-472a-9ea7-b413ea800a59 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:20:55.839743 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 774/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:21:05.226809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=11 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:21:05.833000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:21.961133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e41596-1011-4c61-9a26-e65944ccbd4a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:21.961837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e41596-1011-4c61-9a26-e65944ccbd4a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:21.961837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e41596-1011-4c61-9a26-e65944ccbd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:21.995025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d56e3-88e1-4cfd-a9a0-935c7d27e4d1 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:21.995892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b6e41596-1011-4c61-9a26-e65944ccbd4a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:21.996338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d56e3-88e1-4cfd-a9a0-935c7d27e4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:21.996870 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d56e3-88e1-4cfd-a9a0-935c7d27e4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:21.998195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b6e41596-1011-4c61-9a26-e65944ccbd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.019580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 766/1540] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.027531 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfc964-16bb-41e3-8d6e-23fe8570bf20 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.027816 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfc964-16bb-41e3-8d6e-23fe8570bf20 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.028551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfc964-16bb-41e3-8d6e-23fe8570bf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.029859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-885d56e3-88e1-4cfd-a9a0-935c7d27e4d1 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.031180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-885d56e3-88e1-4cfd-a9a0-935c7d27e4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.048525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 775/1541] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:22:22.049973 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22309d4-e5fa-44b3-b76f-9daa1d14f815 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.050360 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22309d4-e5fa-44b3-b76f-9daa1d14f815 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.050730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22309d4-e5fa-44b3-b76f-9daa1d14f815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.063343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a6dfc964-16bb-41e3-8d6e-23fe8570bf20 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.064828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a6dfc964-16bb-41e3-8d6e-23fe8570bf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.082827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 767/1542] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:22:22.084398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0989a-755a-4532-89c5-809d7a238a72 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.084862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0989a-755a-4532-89c5-809d7a238a72 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.085297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0989a-755a-4532-89c5-809d7a238a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.095321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-d22309d4-e5fa-44b3-b76f-9daa1d14f815 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.095321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d22309d4-e5fa-44b3-b76f-9daa1d14f815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.109112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 776/1543] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.110878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6d9e8-9718-4e46-8008-e2d44c915293 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.111427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6d9e8-9718-4e46-8008-e2d44c915293 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.111909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6d9e8-9718-4e46-8008-e2d44c915293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.128311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ead0989a-755a-4532-89c5-809d7a238a72 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.129544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ead0989a-755a-4532-89c5-809d7a238a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.148278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8de6d9e8-9718-4e46-8008-e2d44c915293 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.149991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8de6d9e8-9718-4e46-8008-e2d44c915293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.166667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 777/1544] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.168393 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2acb0-2fd8-4338-a752-1d63b6f488d0 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.168954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2acb0-2fd8-4338-a752-1d63b6f488d0 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.169459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2acb0-2fd8-4338-a752-1d63b6f488d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.172273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 768/1545] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.179276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0989a-755a-4532-89c5-809d7a238a72 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.187955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0989a-755a-4532-89c5-809d7a238a72 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.200021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270ec85-3562-4f37-a757-488b1844286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.201082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270ec85-3562-4f37-a757-488b1844286e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.201592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270ec85-3562-4f37-a757-488b1844286e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.202082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270ec85-3562-4f37-a757-488b1844286e admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.202966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270ec85-3562-4f37-a757-488b1844286e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:22.203538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270ec85-3562-4f37-a757-488b1844286e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.205388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270ec85-3562-4f37-a757-488b1844286e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.221050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-20c2acb0-2fd8-4338-a752-1d63b6f488d0 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.222206 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-20c2acb0-2fd8-4338-a752-1d63b6f488d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.226696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 769/1546] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:22.228141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270ec85-3562-4f37-a757-488b1844286e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.231031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 778/1547] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.231921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2acb0-2fd8-4338-a752-1d63b6f488d0 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.242307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270ec85-3562-4f37-a757-488b1844286e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.245686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2acb0-2fd8-4338-a752-1d63b6f488d0 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.249734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d2614-f950-4305-9ed9-31cd376c1b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.250603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb55da0-2902-49c6-bc3e-bc496715d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.251042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d2614-f950-4305-9ed9-31cd376c1b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.251221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55da0-2902-49c6-bc3e-bc496715d3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.251585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55da0-2902-49c6-bc3e-bc496715d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.251857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55da0-2902-49c6-bc3e-bc496715d3f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.252121 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d2614-f950-4305-9ed9-31cd376c1b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.252502 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb55da0-2902-49c6-bc3e-bc496715d3f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:22.252780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d2614-f950-4305-9ed9-31cd376c1b93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.252897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb55da0-2902-49c6-bc3e-bc496715d3f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.253850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d2614-f950-4305-9ed9-31cd376c1b93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:22.253959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: WARNING py.warnings [None req-2cb55da0-2902-49c6-bc3e-bc496715d3f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:22:22.253959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: warnings.warn(msg) Sep 03 01:22:22.253959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: Sep 03 01:22:22.254591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d2614-f950-4305-9ed9-31cd376c1b93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.255374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb55da0-2902-49c6-bc3e-bc496715d3f8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.256395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d2614-f950-4305-9ed9-31cd376c1b93 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.268138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 779/1548] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:22.271366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 770/1549] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:22.271509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02936e22-89bd-444e-ab41-ec96e520bca0 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.271509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02936e22-89bd-444e-ab41-ec96e520bca0 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.271509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02936e22-89bd-444e-ab41-ec96e520bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.271760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08197b8-833f-45b7-8611-8dd16e55fa4e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.271760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08197b8-833f-45b7-8611-8dd16e55fa4e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.271760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08197b8-833f-45b7-8611-8dd16e55fa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.289474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-02936e22-89bd-444e-ab41-ec96e520bca0 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.290674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-02936e22-89bd-444e-ab41-ec96e520bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.290811 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d08197b8-833f-45b7-8611-8dd16e55fa4e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.292151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d08197b8-833f-45b7-8611-8dd16e55fa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.298460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 780/1550] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.299654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a760ab-8583-4463-b996-1088e4a72456 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.299932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a760ab-8583-4463-b996-1088e4a72456 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.300384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 771/1551] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.301155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08197b8-833f-45b7-8611-8dd16e55fa4e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.307595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a760ab-8583-4463-b996-1088e4a72456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.313565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08197b8-833f-45b7-8611-8dd16e55fa4e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.319379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fff1e-58e0-4a90-95ac-d34e48f7d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.320002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fff1e-58e0-4a90-95ac-d34e48f7d308 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.320280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fff1e-58e0-4a90-95ac-d34e48f7d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.320552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fff1e-58e0-4a90-95ac-d34e48f7d308 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.321188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fff1e-58e0-4a90-95ac-d34e48f7d308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.322642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-269fff1e-58e0-4a90-95ac-d34e48f7d308 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:22:22.322642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 03 01:22:22.322642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: Sep 03 01:22:22.323917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fff1e-58e0-4a90-95ac-d34e48f7d308 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.327863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-24a760ab-8583-4463-b996-1088e4a72456 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.329087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-24a760ab-8583-4463-b996-1088e4a72456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.338309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 781/1552] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.340811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adf4b3-825f-4253-8167-5ce7aadb33f0 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.341129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adf4b3-825f-4253-8167-5ce7aadb33f0 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.341424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adf4b3-825f-4253-8167-5ce7aadb33f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.362238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-50adf4b3-825f-4253-8167-5ce7aadb33f0 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.363505 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-50adf4b3-825f-4253-8167-5ce7aadb33f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.375128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 782/1553] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.375346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 772/1554] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:22.375465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faacc38-a255-4d9f-9f64-23825648d46f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.375465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faacc38-a255-4d9f-9f64-23825648d46f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.375465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faacc38-a255-4d9f-9f64-23825648d46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.375992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fff1e-58e0-4a90-95ac-d34e48f7d308 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.392649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2faacc38-a255-4d9f-9f64-23825648d46f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.393858 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2faacc38-a255-4d9f-9f64-23825648d46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.437652 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fff1e-58e0-4a90-95ac-d34e48f7d308 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.442408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368270f8-fde8-400c-a763-c0ccb4b00a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.443035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368270f8-fde8-400c-a763-c0ccb4b00a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.443389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368270f8-fde8-400c-a763-c0ccb4b00a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.443673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368270f8-fde8-400c-a763-c0ccb4b00a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.444498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368270f8-fde8-400c-a763-c0ccb4b00a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.446499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368270f8-fde8-400c-a763-c0ccb4b00a9a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.453774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 783/1555] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.454638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faacc38-a255-4d9f-9f64-23825648d46f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.465060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faacc38-a255-4d9f-9f64-23825648d46f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.470123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a899cc9-bb82-499c-bea6-51a7ffecc44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.470730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899cc9-bb82-499c-bea6-51a7ffecc44f admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.471010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899cc9-bb82-499c-bea6-51a7ffecc44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.471349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a899cc9-bb82-499c-bea6-51a7ffecc44f admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.471933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a899cc9-bb82-499c-bea6-51a7ffecc44f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.473862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a899cc9-bb82-499c-bea6-51a7ffecc44f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.478464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 773/1556] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:22.480414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1fce5-d22f-4072-8aac-a30a1561e878 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.480703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1fce5-d22f-4072-8aac-a30a1561e878 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.480977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1fce5-d22f-4072-8aac-a30a1561e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.501485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a7a1fce5-d22f-4072-8aac-a30a1561e878 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.506022 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 784/1557] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:22.506177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a7a1fce5-d22f-4072-8aac-a30a1561e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.506305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d99d-8ad4-4c8c-ad1c-1b4202f20118 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.506305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d99d-8ad4-4c8c-ad1c-1b4202f20118 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.506305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d99d-8ad4-4c8c-ad1c-1b4202f20118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.523240 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4ea0d99d-8ad4-4c8c-ad1c-1b4202f20118 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.524531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4ea0d99d-8ad4-4c8c-ad1c-1b4202f20118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.576206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 774/1558] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.577563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84ffdd-f0e5-4955-b303-17120401211e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.577975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84ffdd-f0e5-4955-b303-17120401211e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.578263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84ffdd-f0e5-4955-b303-17120401211e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.585902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:22.588426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 785/1559] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.589556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d99d-8ad4-4c8c-ad1c-1b4202f20118 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.603479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8e84ffdd-f0e5-4955-b303-17120401211e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.605711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8e84ffdd-f0e5-4955-b303-17120401211e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.608210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d99d-8ad4-4c8c-ad1c-1b4202f20118 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.612924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce8dac-19a6-4ff5-92cd-9fb94ead19c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.613702 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce8dac-19a6-4ff5-92cd-9fb94ead19c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.614048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce8dac-19a6-4ff5-92cd-9fb94ead19c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.614390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce8dac-19a6-4ff5-92cd-9fb94ead19c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.614534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 775/1560] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.615129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce8dac-19a6-4ff5-92cd-9fb94ead19c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.616242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: WARNING py.warnings [None req-e9ce8dac-19a6-4ff5-92cd-9fb94ead19c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:22:22.616242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: warnings.warn(msg) Sep 03 01:22:22.616242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: Sep 03 01:22:22.617484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce8dac-19a6-4ff5-92cd-9fb94ead19c9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.618984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84ffdd-f0e5-4955-b303-17120401211e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.628868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84ffdd-f0e5-4955-b303-17120401211e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.634253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47884f-cce2-40b5-bba4-c2051bc28a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.634942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47884f-cce2-40b5-bba4-c2051bc28a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.635275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47884f-cce2-40b5-bba4-c2051bc28a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.635625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47884f-cce2-40b5-bba4-c2051bc28a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.636488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47884f-cce2-40b5-bba4-c2051bc28a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:22.636773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47884f-cce2-40b5-bba4-c2051bc28a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.638906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47884f-cce2-40b5-bba4-c2051bc28a1c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.642399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 786/1561] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/users => generated 291 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:22.644750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e8e8d-1a9a-40ff-b3d4-dfb27e5e5986 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.645102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e8e8d-1a9a-40ff-b3d4-dfb27e5e5986 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.645507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e8e8d-1a9a-40ff-b3d4-dfb27e5e5986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.651584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 776/1562] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:22.652388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47884f-cce2-40b5-bba4-c2051bc28a1c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.653176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:22.664096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47884f-cce2-40b5-bba4-c2051bc28a1c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.666633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-096e8e8d-1a9a-40ff-b3d4-dfb27e5e5986 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:22.668188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-096e8e8d-1a9a-40ff-b3d4-dfb27e5e5986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:22.668836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154219-4ff1-4387-a672-817b7d8292f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.669441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154219-4ff1-4387-a672-817b7d8292f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.669718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154219-4ff1-4387-a672-817b7d8292f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.670015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154219-4ff1-4387-a672-817b7d8292f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.670642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b154219-4ff1-4387-a672-817b7d8292f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.672569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b154219-4ff1-4387-a672-817b7d8292f1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.676370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 787/1563] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:22.680161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e8e8d-1a9a-40ff-b3d4-dfb27e5e5986 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.689103 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e8e8d-1a9a-40ff-b3d4-dfb27e5e5986 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.694055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c71c0-fd07-4705-a44a-d0c78b250dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.694655 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c71c0-fd07-4705-a44a-d0c78b250dfb admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.694931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c71c0-fd07-4705-a44a-d0c78b250dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.695199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c71c0-fd07-4705-a44a-d0c78b250dfb admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.695853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c71c0-fd07-4705-a44a-d0c78b250dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.696381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 777/1564] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:22.697359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154219-4ff1-4387-a672-817b7d8292f1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.698067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c71c0-fd07-4705-a44a-d0c78b250dfb admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.707569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154219-4ff1-4387-a672-817b7d8292f1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.713602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0654-a12b-4ff4-a311-4bb9d78362cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.714312 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0654-a12b-4ff4-a311-4bb9d78362cb admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.714701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0654-a12b-4ff4-a311-4bb9d78362cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.714978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0654-a12b-4ff4-a311-4bb9d78362cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.715693 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0654-a12b-4ff4-a311-4bb9d78362cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:22.715993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0654-a12b-4ff4-a311-4bb9d78362cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.717690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0654-a12b-4ff4-a311-4bb9d78362cb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.720147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 788/1565] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:22.720812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c71c0-fd07-4705-a44a-d0c78b250dfb admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.730476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c71c0-fd07-4705-a44a-d0c78b250dfb admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.738844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 778/1566] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:22.738844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0654-a12b-4ff4-a311-4bb9d78362cb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.739705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4a7ec-8bb2-4df6-ba8b-bcac6a70c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.740445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4a7ec-8bb2-4df6-ba8b-bcac6a70c8ec admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.740894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4a7ec-8bb2-4df6-ba8b-bcac6a70c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.741325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4a7ec-8bb2-4df6-ba8b-bcac6a70c8ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.742127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4a7ec-8bb2-4df6-ba8b-bcac6a70c8ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:22.742415 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4a7ec-8bb2-4df6-ba8b-bcac6a70c8ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.744099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4a7ec-8bb2-4df6-ba8b-bcac6a70c8ec admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.748728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0654-a12b-4ff4-a311-4bb9d78362cb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.753679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb5a29-364f-4d67-9752-2fce6992bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.754439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb5a29-364f-4d67-9752-2fce6992bd6b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.754714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb5a29-364f-4d67-9752-2fce6992bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.754990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb5a29-364f-4d67-9752-2fce6992bd6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.755670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb5a29-364f-4d67-9752-2fce6992bd6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:22.755970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb5a29-364f-4d67-9752-2fce6992bd6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.757630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb5a29-364f-4d67-9752-2fce6992bd6b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.758073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 789/1567] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:22.758930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4a7ec-8bb2-4df6-ba8b-bcac6a70c8ec admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.770226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 779/1568] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:22.771344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb5a29-364f-4d67-9752-2fce6992bd6b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.779606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4a7ec-8bb2-4df6-ba8b-bcac6a70c8ec admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.781898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb5a29-364f-4d67-9752-2fce6992bd6b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.784238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43073318-b650-4436-86e4-60e300336138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.784875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073318-b650-4436-86e4-60e300336138 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.785185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073318-b650-4436-86e4-60e300336138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.785488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073318-b650-4436-86e4-60e300336138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.786125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43073318-b650-4436-86e4-60e300336138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.786632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadf1fa-9f4f-4dd4-8ae8-a749cad687d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.787337 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf1fa-9f4f-4dd4-8ae8-a749cad687d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.787632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf1fa-9f4f-4dd4-8ae8-a749cad687d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.787746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43073318-b650-4436-86e4-60e300336138 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.788028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf1fa-9f4f-4dd4-8ae8-a749cad687d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.788661 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadf1fa-9f4f-4dd4-8ae8-a749cad687d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.791148 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadf1fa-9f4f-4dd4-8ae8-a749cad687d5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.800831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 790/1569] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:22.800831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43073318-b650-4436-86e4-60e300336138 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.808102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43073318-b650-4436-86e4-60e300336138 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.813156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf2f0-1285-494f-b5f4-f574b68faaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.813738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf2f0-1285-494f-b5f4-f574b68faaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.814012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf2f0-1285-494f-b5f4-f574b68faaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.814280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf2f0-1285-494f-b5f4-f574b68faaf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.814917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdf2f0-1285-494f-b5f4-f574b68faaf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:22.815213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdf2f0-1285-494f-b5f4-f574b68faaf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.816838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdf2f0-1285-494f-b5f4-f574b68faaf2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.824796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 780/1570] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:22.824796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadf1fa-9f4f-4dd4-8ae8-a749cad687d5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.836180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 791/1571] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:22.836180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf2f0-1285-494f-b5f4-f574b68faaf2 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.842449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf2f0-1285-494f-b5f4-f574b68faaf2 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.890078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadf1fa-9f4f-4dd4-8ae8-a749cad687d5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.894709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdfcc7-8056-4be5-b15a-9915f434a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.895358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdfcc7-8056-4be5-b15a-9915f434a3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.895639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdfcc7-8056-4be5-b15a-9915f434a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.895910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdfcc7-8056-4be5-b15a-9915f434a3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.896586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdfcc7-8056-4be5-b15a-9915f434a3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.898183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdfcc7-8056-4be5-b15a-9915f434a3d1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.898655 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3cc17-d757-407e-b051-2729cb483c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.899286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3cc17-d757-407e-b051-2729cb483c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.899605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3cc17-d757-407e-b051-2729cb483c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.899881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3cc17-d757-407e-b051-2729cb483c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.900514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3cc17-d757-407e-b051-2729cb483c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.902141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3cc17-d757-407e-b051-2729cb483c13 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.908552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 781/1572] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:22.912184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdfcc7-8056-4be5-b15a-9915f434a3d1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.912664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 792/1573] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:22.916140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3cc17-d757-407e-b051-2729cb483c13 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.922757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdfcc7-8056-4be5-b15a-9915f434a3d1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.926089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3cc17-d757-407e-b051-2729cb483c13 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:22.927587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6cf10-6b97-4800-b8e8-4c4d23db6e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.928212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6cf10-6b97-4800-b8e8-4c4d23db6e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.928463 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6cf10-6b97-4800-b8e8-4c4d23db6e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.928733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6cf10-6b97-4800-b8e8-4c4d23db6e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.929366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6cf10-6b97-4800-b8e8-4c4d23db6e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.931116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e347531-0c7f-4d8c-9e67-020bec0685fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:22.931283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6cf10-6b97-4800-b8e8-4c4d23db6e82 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.931774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e347531-0c7f-4d8c-9e67-020bec0685fe admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:22.932056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e347531-0c7f-4d8c-9e67-020bec0685fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:22.932323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e347531-0c7f-4d8c-9e67-020bec0685fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:22.932935 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e347531-0c7f-4d8c-9e67-020bec0685fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:22.934932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e347531-0c7f-4d8c-9e67-020bec0685fe admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:22.963808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 782/1574] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:22.964523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6cf10-6b97-4800-b8e8-4c4d23db6e82 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:22.969251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 793/1575] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:22.969991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e347531-0c7f-4d8c-9e67-020bec0685fe admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.018675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:23.030596 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6cf10-6b97-4800-b8e8-4c4d23db6e82 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.033446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e347531-0c7f-4d8c-9e67-020bec0685fe admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.035977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d398f-55d6-49d1-9fbf-6aa699b5f998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.036586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d398f-55d6-49d1-9fbf-6aa699b5f998 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.036859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d398f-55d6-49d1-9fbf-6aa699b5f998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.037128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d398f-55d6-49d1-9fbf-6aa699b5f998 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.037756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d398f-55d6-49d1-9fbf-6aa699b5f998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.038051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db7af2-37c7-4842-bad0-512a97c1216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.038663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7af2-37c7-4842-bad0-512a97c1216f admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.038940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7af2-37c7-4842-bad0-512a97c1216f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.039214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7af2-37c7-4842-bad0-512a97c1216f admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.039686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d398f-55d6-49d1-9fbf-6aa699b5f998 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.039890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db7af2-37c7-4842-bad0-512a97c1216f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.041489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db7af2-37c7-4842-bad0-512a97c1216f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.052329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 794/1576] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.055835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db7af2-37c7-4842-bad0-512a97c1216f admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.063313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db7af2-37c7-4842-bad0-512a97c1216f admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.068044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fa02b-b3d3-4111-b172-b9ba6cddaf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.068639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fa02b-b3d3-4111-b172-b9ba6cddaf2a admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.068786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 783/1577] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:22 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:23.068975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fa02b-b3d3-4111-b172-b9ba6cddaf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.069186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fa02b-b3d3-4111-b172-b9ba6cddaf2a admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.069471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d398f-55d6-49d1-9fbf-6aa699b5f998 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.069798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fa02b-b3d3-4111-b172-b9ba6cddaf2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.071925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fa02b-b3d3-4111-b172-b9ba6cddaf2a admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.083234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:23.100501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 795/1578] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:23 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:23.100501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fa02b-b3d3-4111-b172-b9ba6cddaf2a admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.107874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fa02b-b3d3-4111-b172-b9ba6cddaf2a admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.141021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d398f-55d6-49d1-9fbf-6aa699b5f998 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.146358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d3a8-2350-4823-a2a5-7d8d4a5bdadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.146984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d3a8-2350-4823-a2a5-7d8d4a5bdadc admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.147279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d3a8-2350-4823-a2a5-7d8d4a5bdadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.147569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d3a8-2350-4823-a2a5-7d8d4a5bdadc admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.148354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583d3a8-2350-4823-a2a5-7d8d4a5bdadc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.150272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583d3a8-2350-4823-a2a5-7d8d4a5bdadc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.163824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b60bc0-9a4f-48cf-8c40-aa9976bd2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.164519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b60bc0-9a4f-48cf-8c40-aa9976bd2218 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.164866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b60bc0-9a4f-48cf-8c40-aa9976bd2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.165213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b60bc0-9a4f-48cf-8c40-aa9976bd2218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.165857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b60bc0-9a4f-48cf-8c40-aa9976bd2218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.167498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b60bc0-9a4f-48cf-8c40-aa9976bd2218 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.177794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 796/1579] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.178642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b60bc0-9a4f-48cf-8c40-aa9976bd2218 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.178856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 784/1580] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:23 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:23.179874 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d3a8-2350-4823-a2a5-7d8d4a5bdadc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.192312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b60bc0-9a4f-48cf-8c40-aa9976bd2218 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.246116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d3a8-2350-4823-a2a5-7d8d4a5bdadc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.249784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a1550-323d-4bed-b33d-54f72492813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.250399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a1550-323d-4bed-b33d-54f72492813f admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.250674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a1550-323d-4bed-b33d-54f72492813f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.250791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ec39-3e16-4bae-98f0-0c4f8d0cd62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.251012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a1550-323d-4bed-b33d-54f72492813f admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.251411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ec39-3e16-4bae-98f0-0c4f8d0cd62d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.251672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ec39-3e16-4bae-98f0-0c4f8d0cd62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.251800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a1550-323d-4bed-b33d-54f72492813f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.251971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ec39-3e16-4bae-98f0-0c4f8d0cd62d admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.252612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ec39-3e16-4bae-98f0-0c4f8d0cd62d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.253581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a1550-323d-4bed-b33d-54f72492813f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.254522 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ec39-3e16-4bae-98f0-0c4f8d0cd62d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.267177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 797/1581] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.267177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a1550-323d-4bed-b33d-54f72492813f admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.278003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a1550-323d-4bed-b33d-54f72492813f admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.280464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 785/1582] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:23 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:23.281326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ec39-3e16-4bae-98f0-0c4f8d0cd62d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.285853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb15c51-ecc3-4940-9dd6-4bec62ad6693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.286458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb15c51-ecc3-4940-9dd6-4bec62ad6693 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.286731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb15c51-ecc3-4940-9dd6-4bec62ad6693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.286999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb15c51-ecc3-4940-9dd6-4bec62ad6693 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.287652 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb15c51-ecc3-4940-9dd6-4bec62ad6693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.289568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb15c51-ecc3-4940-9dd6-4bec62ad6693 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.290892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ec39-3e16-4bae-98f0-0c4f8d0cd62d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.295635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dc22e-9e24-4d87-b593-7981d85bc248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.296282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc22e-9e24-4d87-b593-7981d85bc248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.296558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc22e-9e24-4d87-b593-7981d85bc248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.296832 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc22e-9e24-4d87-b593-7981d85bc248 admin admin] PATH_INFO: `/v3/projects/9e45affb8d13416a935486243ad99e21/users/a4fe3e8893db4273b6b097e96e896b2f/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.312412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 798/1583] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:23 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:23.312889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dc22e-9e24-4d87-b593-7981d85bc248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e45affb8d13416a935486243ad99e21, user_id=a4fe3e8893db4273b6b097e96e896b2f, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.313926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-904dc22e-9e24-4d87-b593-7981d85bc248 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:22:23.313926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 03 01:22:23.313926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: Sep 03 01:22:23.315894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dc22e-9e24-4d87-b593-7981d85bc248 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.316096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb15c51-ecc3-4940-9dd6-4bec62ad6693 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.326948 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb15c51-ecc3-4940-9dd6-4bec62ad6693 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.332816 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 786/1584] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:23 2022] PUT /identity/v3/projects/9e45affb8d13416a935486243ad99e21/users/a4fe3e8893db4273b6b097e96e896b2f/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:23.333881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dc22e-9e24-4d87-b593-7981d85bc248 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.373979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:23.384804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633b045-e821-4bbf-aa9f-277269e005d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.385425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b045-e821-4bbf-aa9f-277269e005d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.385703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b045-e821-4bbf-aa9f-277269e005d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.385982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b045-e821-4bbf-aa9f-277269e005d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.386604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633b045-e821-4bbf-aa9f-277269e005d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.388879 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633b045-e821-4bbf-aa9f-277269e005d7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.406760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:23.411190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dc22e-9e24-4d87-b593-7981d85bc248 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.415436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 799/1585] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:23 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:23.416434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e9e34-3f0a-44be-a10b-23e8b9da38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.416777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633b045-e821-4bbf-aa9f-277269e005d7 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.417065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e9e34-3f0a-44be-a10b-23e8b9da38bd admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.417346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e9e34-3f0a-44be-a10b-23e8b9da38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.417620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e9e34-3f0a-44be-a10b-23e8b9da38bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.418399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e9e34-3f0a-44be-a10b-23e8b9da38bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.420148 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e9e34-3f0a-44be-a10b-23e8b9da38bd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.428004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633b045-e821-4bbf-aa9f-277269e005d7 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.433416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 787/1586] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.433416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e9e34-3f0a-44be-a10b-23e8b9da38bd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.433647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88c835-a9c1-4399-a360-e33609aeb80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.434151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88c835-a9c1-4399-a360-e33609aeb80d admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.434580 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88c835-a9c1-4399-a360-e33609aeb80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.434981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88c835-a9c1-4399-a360-e33609aeb80d admin admin] PATH_INFO: `/v3/projects/accaf63f55e149aea52750361429e68a/users/07f4d63ddeee4badb517ce829f816fad/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.441288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e9e34-3f0a-44be-a10b-23e8b9da38bd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.445970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3cb0-1ede-4127-84db-50441367622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.446564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3cb0-1ede-4127-84db-50441367622e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.446842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3cb0-1ede-4127-84db-50441367622e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.447116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3cb0-1ede-4127-84db-50441367622e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.447781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3cb0-1ede-4127-84db-50441367622e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.449827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3cb0-1ede-4127-84db-50441367622e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.450245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88c835-a9c1-4399-a360-e33609aeb80d admin admin] RBAC: Authorizing `identity:create_grant(project_id=accaf63f55e149aea52750361429e68a, user_id=07f4d63ddeee4badb517ce829f816fad, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.453031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88c835-a9c1-4399-a360-e33609aeb80d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.471873 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 800/1587] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:23 2022] PUT /identity/v3/projects/accaf63f55e149aea52750361429e68a/users/07f4d63ddeee4badb517ce829f816fad/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:23.475669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 788/1588] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:23 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:23.475669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3cb0-1ede-4127-84db-50441367622e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.476558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88c835-a9c1-4399-a360-e33609aeb80d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.484182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3cb0-1ede-4127-84db-50441367622e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.539390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88c835-a9c1-4399-a360-e33609aeb80d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.542714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce582be-11ef-42d9-950c-dab4bb6c412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.543364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce582be-11ef-42d9-950c-dab4bb6c412b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.543690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce582be-11ef-42d9-950c-dab4bb6c412b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.543973 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce582be-11ef-42d9-950c-dab4bb6c412b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.544507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e5463-fe38-4c91-816f-f068bfae2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.544628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce582be-11ef-42d9-950c-dab4bb6c412b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.545188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5463-fe38-4c91-816f-f068bfae2ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.545466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5463-fe38-4c91-816f-f068bfae2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.545736 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e5463-fe38-4c91-816f-f068bfae2ccd admin admin] PATH_INFO: `/v3/projects/4ff356ac6962437c9662f12e8877d409/users/9c6321d3fb5d4265aaff699fae301ed4/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.546175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce582be-11ef-42d9-950c-dab4bb6c412b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.560679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 789/1589] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.560679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce582be-11ef-42d9-950c-dab4bb6c412b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.561956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e5463-fe38-4c91-816f-f068bfae2ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff356ac6962437c9662f12e8877d409, user_id=9c6321d3fb5d4265aaff699fae301ed4, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.564867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e5463-fe38-4c91-816f-f068bfae2ccd admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.570012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce582be-11ef-42d9-950c-dab4bb6c412b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.575223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b34d9b-d911-4a75-af51-9c71d9425f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.575875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b34d9b-d911-4a75-af51-9c71d9425f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.576202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b34d9b-d911-4a75-af51-9c71d9425f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.576499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b34d9b-d911-4a75-af51-9c71d9425f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.577138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b34d9b-d911-4a75-af51-9c71d9425f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.578706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b34d9b-d911-4a75-af51-9c71d9425f8e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.580072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 801/1590] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:23 2022] PUT /identity/v3/projects/4ff356ac6962437c9662f12e8877d409/users/9c6321d3fb5d4265aaff699fae301ed4/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:23.581328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25b939-1877-4cc6-8e9c-b183670c625f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.581744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25b939-1877-4cc6-8e9c-b183670c625f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.582026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25b939-1877-4cc6-8e9c-b183670c625f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.590721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 790/1591] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.591717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b34d9b-d911-4a75-af51-9c71d9425f8e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.601585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b34d9b-d911-4a75-af51-9c71d9425f8e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.611383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3e25b939-1877-4cc6-8e9c-b183670c625f None None] MFA Rules not processed for user `a4fe3e8893db4273b6b097e96e896b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:23.612649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3e25b939-1877-4cc6-8e9c-b183670c625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:23.660483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10f337-bf61-4214-aa0e-c54ec62f0c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.661124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10f337-bf61-4214-aa0e-c54ec62f0c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.661401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10f337-bf61-4214-aa0e-c54ec62f0c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.661788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10f337-bf61-4214-aa0e-c54ec62f0c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.662431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10f337-bf61-4214-aa0e-c54ec62f0c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.664135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10f337-bf61-4214-aa0e-c54ec62f0c4a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.674201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 791/1592] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.674999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10f337-bf61-4214-aa0e-c54ec62f0c4a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.683348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 802/1593] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:23.685241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cd48f-7a49-4431-9b8f-d063280d70e2 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.685528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cd48f-7a49-4431-9b8f-d063280d70e2 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.685802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cd48f-7a49-4431-9b8f-d063280d70e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.685956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10f337-bf61-4214-aa0e-c54ec62f0c4a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.690963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531fbc9-03d4-4aa8-9d23-c0b0463aa9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.691585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531fbc9-03d4-4aa8-9d23-c0b0463aa9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.691865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531fbc9-03d4-4aa8-9d23-c0b0463aa9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.692131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531fbc9-03d4-4aa8-9d23-c0b0463aa9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.692760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531fbc9-03d4-4aa8-9d23-c0b0463aa9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.694313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531fbc9-03d4-4aa8-9d23-c0b0463aa9f1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.704808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4f1cd48f-7a49-4431-9b8f-d063280d70e2 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:23.705264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 792/1594] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.706057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531fbc9-03d4-4aa8-9d23-c0b0463aa9f1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.706175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4f1cd48f-7a49-4431-9b8f-d063280d70e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:23.714131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 803/1595] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:23.714918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cd48f-7a49-4431-9b8f-d063280d70e2 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.715756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531fbc9-03d4-4aa8-9d23-c0b0463aa9f1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.722605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e76af-6473-4fd0-b786-9da741ff814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.723225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e76af-6473-4fd0-b786-9da741ff814d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.723538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e76af-6473-4fd0-b786-9da741ff814d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.723813 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e76af-6473-4fd0-b786-9da741ff814d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.724455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e76af-6473-4fd0-b786-9da741ff814d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.724662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cd48f-7a49-4431-9b8f-d063280d70e2 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.726040 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e76af-6473-4fd0-b786-9da741ff814d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.730185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5735c-6be5-4a68-8df1-23af6574bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.730778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5735c-6be5-4a68-8df1-23af6574bcce admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.731052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5735c-6be5-4a68-8df1-23af6574bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.731388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5735c-6be5-4a68-8df1-23af6574bcce admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.732017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5735c-6be5-4a68-8df1-23af6574bcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.733601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5735c-6be5-4a68-8df1-23af6574bcce admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.739561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 793/1596] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.739561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd27b-265b-4479-8973-ef4a944b92c3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.739561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd27b-265b-4479-8973-ef4a944b92c3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.739561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd27b-265b-4479-8973-ef4a944b92c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.744852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 804/1597] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.745534 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5735c-6be5-4a68-8df1-23af6574bcce admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.749313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:23.755452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5735c-6be5-4a68-8df1-23af6574bcce admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.760767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7b04-117c-48ba-a624-19369d96f9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.761152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8decd27b-265b-4479-8973-ef4a944b92c3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:23.761364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7b04-117c-48ba-a624-19369d96f9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.761642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7b04-117c-48ba-a624-19369d96f9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.761914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7b04-117c-48ba-a624-19369d96f9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.762425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8decd27b-265b-4479-8973-ef4a944b92c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:23.762631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca7b04-117c-48ba-a624-19369d96f9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.764495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca7b04-117c-48ba-a624-19369d96f9f9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.770878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 794/1598] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:23.771714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decd27b-265b-4479-8973-ef4a944b92c3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.777789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 805/1599] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.777789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7b04-117c-48ba-a624-19369d96f9f9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.781495 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decd27b-265b-4479-8973-ef4a944b92c3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.786085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce482f3-0b37-4234-a96e-c276149c3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.786707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce482f3-0b37-4234-a96e-c276149c3fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.787091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce482f3-0b37-4234-a96e-c276149c3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.787305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce482f3-0b37-4234-a96e-c276149c3fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.787950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce482f3-0b37-4234-a96e-c276149c3fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.789599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce482f3-0b37-4234-a96e-c276149c3fa0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.789716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7b04-117c-48ba-a624-19369d96f9f9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.794100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1dbf-b22b-40f1-86cc-6ba08cf54a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.794697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1dbf-b22b-40f1-86cc-6ba08cf54a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.794987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1dbf-b22b-40f1-86cc-6ba08cf54a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.795234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1dbf-b22b-40f1-86cc-6ba08cf54a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.795872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df1dbf-b22b-40f1-86cc-6ba08cf54a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.798037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df1dbf-b22b-40f1-86cc-6ba08cf54a23 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.799871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 795/1600] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.800644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce482f3-0b37-4234-a96e-c276149c3fa0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.810679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce482f3-0b37-4234-a96e-c276149c3fa0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.814531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:23.815458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b2e07-9c84-413c-8633-c8ca85814bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.815956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b2e07-9c84-413c-8633-c8ca85814bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.816331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b2e07-9c84-413c-8633-c8ca85814bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.816547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b2e07-9c84-413c-8633-c8ca85814bdd admin admin] PATH_INFO: `/v3/projects/3ed07a7365bd4816909b84a48eaeafd7/users/e1d4c5d0ca5445f7b30a7eddd276fae1/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.829068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 806/1601] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:23 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:23.830064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1dbf-b22b-40f1-86cc-6ba08cf54a23 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.832326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b2e07-9c84-413c-8633-c8ca85814bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed07a7365bd4816909b84a48eaeafd7, user_id=e1d4c5d0ca5445f7b30a7eddd276fae1, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.835220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b2e07-9c84-413c-8633-c8ca85814bdd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.849044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 796/1602] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:23 2022] PUT /identity/v3/projects/3ed07a7365bd4816909b84a48eaeafd7/users/e1d4c5d0ca5445f7b30a7eddd276fae1/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:23.849992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b2e07-9c84-413c-8633-c8ca85814bdd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.891094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1dbf-b22b-40f1-86cc-6ba08cf54a23 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.924861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b2e07-9c84-413c-8633-c8ca85814bdd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.930209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae73d7-cae5-4b3d-b75f-833a2c3f8eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.930871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae73d7-cae5-4b3d-b75f-833a2c3f8eba admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.931149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae73d7-cae5-4b3d-b75f-833a2c3f8eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.931522 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae73d7-cae5-4b3d-b75f-833a2c3f8eba admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.932416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae73d7-cae5-4b3d-b75f-833a2c3f8eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.933986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae73d7-cae5-4b3d-b75f-833a2c3f8eba admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.944606 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 797/1603] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:23.945246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae73d7-cae5-4b3d-b75f-833a2c3f8eba admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.951855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc267f82-1051-4c20-971a-d5624c46c0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.952517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267f82-1051-4c20-971a-d5624c46c0ce service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.952799 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267f82-1051-4c20-971a-d5624c46c0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.953071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267f82-1051-4c20-971a-d5624c46c0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.956244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae73d7-cae5-4b3d-b75f-833a2c3f8eba admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.960806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afea83-056d-49fc-aa14-fe0ca5757284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.961445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afea83-056d-49fc-aa14-fe0ca5757284 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.961721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afea83-056d-49fc-aa14-fe0ca5757284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.961967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afea83-056d-49fc-aa14-fe0ca5757284 admin admin] PATH_INFO: `/v3/projects/4ca6aec441ef4c4288dbf5fae8cc6f3f/users/814a076ad8ec41e1ac04ecdef9cee647/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:23.962251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc267f82-1051-4c20-971a-d5624c46c0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.963759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc267f82-1051-4c20-971a-d5624c46c0ce service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.973651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 807/1604] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:23.974323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc267f82-1051-4c20-971a-d5624c46c0ce service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:23.976854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afea83-056d-49fc-aa14-fe0ca5757284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca6aec441ef4c4288dbf5fae8cc6f3f, user_id=814a076ad8ec41e1ac04ecdef9cee647, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:23.979905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afea83-056d-49fc-aa14-fe0ca5757284 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:23.984687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc267f82-1051-4c20-971a-d5624c46c0ce service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:23.989989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892c181-89d3-4263-9f34-f77aba039033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:23.991082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892c181-89d3-4263-9f34-f77aba039033 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:23.991555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892c181-89d3-4263-9f34-f77aba039033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:23.991825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892c181-89d3-4263-9f34-f77aba039033 admin admin] PATH_INFO: `/v3/projects/c260afe983eb41e6aea078599f155860/users/2092b9ad9759438291d34e33878d0d14/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.007987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 798/1605] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:23 2022] PUT /identity/v3/projects/4ca6aec441ef4c4288dbf5fae8cc6f3f/users/814a076ad8ec41e1ac04ecdef9cee647/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:24.007987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afea83-056d-49fc-aa14-fe0ca5757284 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:24.009888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892c181-89d3-4263-9f34-f77aba039033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c260afe983eb41e6aea078599f155860, user_id=2092b9ad9759438291d34e33878d0d14, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:24.013210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892c181-89d3-4263-9f34-f77aba039033 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:24.028940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 808/1606] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:23 2022] PUT /identity/v3/projects/c260afe983eb41e6aea078599f155860/users/2092b9ad9759438291d34e33878d0d14/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:24.029548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892c181-89d3-4263-9f34-f77aba039033 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:24.079027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afea83-056d-49fc-aa14-fe0ca5757284 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:24.095955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892c181-89d3-4263-9f34-f77aba039033 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:24.101089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1644ff3-8a07-4e45-b4af-78c4dd061700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:24.101758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1644ff3-8a07-4e45-b4af-78c4dd061700 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.102031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1644ff3-8a07-4e45-b4af-78c4dd061700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.102306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1644ff3-8a07-4e45-b4af-78c4dd061700 admin admin] PATH_INFO: `/v3/projects/e7c1f8223fad42e6abd04ff44fd8c528/users/5892a5bf77cd4b42a9765199433adf3b/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.118420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1644ff3-8a07-4e45-b4af-78c4dd061700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c1f8223fad42e6abd04ff44fd8c528, user_id=5892a5bf77cd4b42a9765199433adf3b, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:24.121295 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1644ff3-8a07-4e45-b4af-78c4dd061700 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:24.136314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae084d6-0a01-48e1-a2c5-9ebbda8f5b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:24.136687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 809/1607] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:24 2022] PUT /identity/v3/projects/e7c1f8223fad42e6abd04ff44fd8c528/users/5892a5bf77cd4b42a9765199433adf3b/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:24.138318 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1644ff3-8a07-4e45-b4af-78c4dd061700 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:24.148469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae084d6-0a01-48e1-a2c5-9ebbda8f5b5b service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.148469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae084d6-0a01-48e1-a2c5-9ebbda8f5b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.148469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae084d6-0a01-48e1-a2c5-9ebbda8f5b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.155387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:24.159826 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae084d6-0a01-48e1-a2c5-9ebbda8f5b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:24.162654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae084d6-0a01-48e1-a2c5-9ebbda8f5b5b service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:24.166547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:24.180763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 799/1608] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:24.183674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d84cf-7761-46ae-a773-1e1c6c58372d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.184337 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d84cf-7761-46ae-a773-1e1c6c58372d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.184673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d84cf-7761-46ae-a773-1e1c6c58372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.218398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1e3d84cf-7761-46ae-a773-1e1c6c58372d None None] MFA Rules not processed for user `e1d4c5d0ca5445f7b30a7eddd276fae1`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:24.219901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1e3d84cf-7761-46ae-a773-1e1c6c58372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:24.227482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1644ff3-8a07-4e45-b4af-78c4dd061700 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:24.233940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d13d3-5ee8-46cd-aeb5-fef354578c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:24.234568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d13d3-5ee8-46cd-aeb5-fef354578c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.234848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d13d3-5ee8-46cd-aeb5-fef354578c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.235122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d13d3-5ee8-46cd-aeb5-fef354578c23 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.235836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d13d3-5ee8-46cd-aeb5-fef354578c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:24.237912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d13d3-5ee8-46cd-aeb5-fef354578c23 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:24.267206 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 810/1609] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:24 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:24.268644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d13d3-5ee8-46cd-aeb5-fef354578c23 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:24.281223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d13d3-5ee8-46cd-aeb5-fef354578c23 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:24.286881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3806dcf-af80-4ada-879a-57e0b5670bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:24.287888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806dcf-af80-4ada-879a-57e0b5670bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.288416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806dcf-af80-4ada-879a-57e0b5670bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.288869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806dcf-af80-4ada-879a-57e0b5670bd2 admin admin] PATH_INFO: `/v3/projects/c1488a0b9eb4434b9e78a48cb951c82c/users/1d959b149003454c83105a7ed6ad7003/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.308214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3806dcf-af80-4ada-879a-57e0b5670bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1488a0b9eb4434b9e78a48cb951c82c, user_id=1d959b149003454c83105a7ed6ad7003, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:24.309772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 800/1610] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:24.311388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5dd6-d3c0-4ea0-9e91-66ad0678eb0a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.311894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5dd6-d3c0-4ea0-9e91-66ad0678eb0a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.312025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3806dcf-af80-4ada-879a-57e0b5670bd2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:24.312500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5dd6-d3c0-4ea0-9e91-66ad0678eb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.329819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 811/1611] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:24 2022] PUT /identity/v3/projects/c1488a0b9eb4434b9e78a48cb951c82c/users/1d959b149003454c83105a7ed6ad7003/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:24.331091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e6ad0-95e1-4d9a-ac93-fd6108d65a19 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.331423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e6ad0-95e1-4d9a-ac93-fd6108d65a19 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.331700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e6ad0-95e1-4d9a-ac93-fd6108d65a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.352152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-17da5dd6-d3c0-4ea0-9e91-66ad0678eb0a None None] MFA Rules not processed for user `814a076ad8ec41e1ac04ecdef9cee647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:24.354687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-17da5dd6-d3c0-4ea0-9e91-66ad0678eb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:24.365315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-452e6ad0-95e1-4d9a-ac93-fd6108d65a19 None None] MFA Rules not processed for user `2092b9ad9759438291d34e33878d0d14`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:24.366688 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-452e6ad0-95e1-4d9a-ac93-fd6108d65a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:24.447790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 812/1612] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:24.449060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a52836-b95d-4da5-8e6d-01014b5194c7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.449340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a52836-b95d-4da5-8e6d-01014b5194c7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.449611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a52836-b95d-4da5-8e6d-01014b5194c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.454282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 801/1613] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:24.456530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5dd6-d3c0-4ea0-9e91-66ad0678eb0a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:24.491073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-29a52836-b95d-4da5-8e6d-01014b5194c7 None None] MFA Rules not processed for user `5892a5bf77cd4b42a9765199433adf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:24.492955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-29a52836-b95d-4da5-8e6d-01014b5194c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:24.569174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5dd6-d3c0-4ea0-9e91-66ad0678eb0a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:24.576059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b29953-192d-4316-bf5a-b7b7c36aa8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:24.576708 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b29953-192d-4316-bf5a-b7b7c36aa8bf admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.576984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b29953-192d-4316-bf5a-b7b7c36aa8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.577297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b29953-192d-4316-bf5a-b7b7c36aa8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.578089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b29953-192d-4316-bf5a-b7b7c36aa8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:24.579925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b29953-192d-4316-bf5a-b7b7c36aa8bf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:24.596655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 802/1614] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:24.596655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b29953-192d-4316-bf5a-b7b7c36aa8bf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:24.601197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:24.608124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b29953-192d-4316-bf5a-b7b7c36aa8bf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:24.618050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e405cc-9429-4150-81f7-58cb44ac2fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:24.618881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e405cc-9429-4150-81f7-58cb44ac2fef admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.619164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e405cc-9429-4150-81f7-58cb44ac2fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.619566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e405cc-9429-4150-81f7-58cb44ac2fef admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.620693 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e405cc-9429-4150-81f7-58cb44ac2fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:24.626387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e405cc-9429-4150-81f7-58cb44ac2fef admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:24.628689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 813/1615] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:24.630296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f306a5b-eb6c-4519-b707-7d19d720aa82 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.630691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f306a5b-eb6c-4519-b707-7d19d720aa82 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.630973 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f306a5b-eb6c-4519-b707-7d19d720aa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.634538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:24.656715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6f306a5b-eb6c-4519-b707-7d19d720aa82 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:24.657985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6f306a5b-eb6c-4519-b707-7d19d720aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:24.666476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 803/1616] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:24 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:24.668309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f95ce-d111-4f4e-ad8e-7898d477105f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.668772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f95ce-d111-4f4e-ad8e-7898d477105f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.669134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f95ce-d111-4f4e-ad8e-7898d477105f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.670355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 814/1617] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:24.671287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 804/1618] 10.222.0.39 () {54 vars in 962 bytes} [Sat Sep 3 01:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:22:24.672099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282ede-9e7b-4969-aa6e-efae65560312 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.672300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f95ce-d111-4f4e-ad8e-7898d477105f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:24.672411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282ede-9e7b-4969-aa6e-efae65560312 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.672642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282ede-9e7b-4969-aa6e-efae65560312 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.679489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 815/1619] 10.222.0.39 () {54 vars in 962 bytes} [Sat Sep 3 01:22:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:22:24.680619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282ede-9e7b-4969-aa6e-efae65560312 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:24.768705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f95ce-d111-4f4e-ad8e-7898d477105f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:24.775564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15180ca-b573-4a6d-8d82-5001e851462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:24.776135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282ede-9e7b-4969-aa6e-efae65560312 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:24.776281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15180ca-b573-4a6d-8d82-5001e851462a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.776511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15180ca-b573-4a6d-8d82-5001e851462a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.776951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15180ca-b573-4a6d-8d82-5001e851462a admin admin] PATH_INFO: `/v3/projects/d3493d0125a147db9fcdf7b347b17b74/users/02f6fc62c8de4b13a42951f605e56dbd/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.782112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0b511-aa0a-41e6-8b4c-4c41c72cf155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:24.782776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0b511-aa0a-41e6-8b4c-4c41c72cf155 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.783067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0b511-aa0a-41e6-8b4c-4c41c72cf155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.783470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0b511-aa0a-41e6-8b4c-4c41c72cf155 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.784117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0b511-aa0a-41e6-8b4c-4c41c72cf155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:24.798885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0b511-aa0a-41e6-8b4c-4c41c72cf155 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:24.802174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15180ca-b573-4a6d-8d82-5001e851462a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3493d0125a147db9fcdf7b347b17b74, user_id=02f6fc62c8de4b13a42951f605e56dbd, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:24.806624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15180ca-b573-4a6d-8d82-5001e851462a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:24.834339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 805/1620] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:24 2022] PUT /identity/v3/projects/d3493d0125a147db9fcdf7b347b17b74/users/02f6fc62c8de4b13a42951f605e56dbd/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:24.834339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a152-edd5-419a-bdf2-86a736955539 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.834339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a152-edd5-419a-bdf2-86a736955539 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.834339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a152-edd5-419a-bdf2-86a736955539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.845144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 816/1621] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:24 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:24.848551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766681f-e1e9-4e1f-9a96-e9d72f0685e0 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:24.850369 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766681f-e1e9-4e1f-9a96-e9d72f0685e0 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:24.851107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766681f-e1e9-4e1f-9a96-e9d72f0685e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:24.894177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b8a3a152-edd5-419a-bdf2-86a736955539 None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:24.895861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b8a3a152-edd5-419a-bdf2-86a736955539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:24.898322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3766681f-e1e9-4e1f-9a96-e9d72f0685e0 None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:24.899542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3766681f-e1e9-4e1f-9a96-e9d72f0685e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:24.995143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 817/1622] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Sep 3 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:24.996075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766681f-e1e9-4e1f-9a96-e9d72f0685e0 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:24.996194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 806/1623] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Sep 3 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:24.997412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a152-edd5-419a-bdf2-86a736955539 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:25.061164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766681f-e1e9-4e1f-9a96-e9d72f0685e0 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:25.064903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:25.065129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645488c-92ee-414f-bfc5-4c1aa82e3f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:25.065749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645488c-92ee-414f-bfc5-4c1aa82e3f47 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.066013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645488c-92ee-414f-bfc5-4c1aa82e3f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.066324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645488c-92ee-414f-bfc5-4c1aa82e3f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.083972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a152-edd5-419a-bdf2-86a736955539 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:25.090067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7d77d-a18d-4b6c-af63-8e2dcea2545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:25.091029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7d77d-a18d-4b6c-af63-8e2dcea2545b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.091476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7d77d-a18d-4b6c-af63-8e2dcea2545b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.091866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7d77d-a18d-4b6c-af63-8e2dcea2545b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.092676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7d77d-a18d-4b6c-af63-8e2dcea2545b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:25.094803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7d77d-a18d-4b6c-af63-8e2dcea2545b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:25.104570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:25.141778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 807/1624] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:25.142641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7d77d-a18d-4b6c-af63-8e2dcea2545b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:25.159782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7d77d-a18d-4b6c-af63-8e2dcea2545b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:25.161721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645488c-92ee-414f-bfc5-4c1aa82e3f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:25.163859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645488c-92ee-414f-bfc5-4c1aa82e3f47 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:25.165419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c835b55-7a7b-43ee-91ae-a810f2dd119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:25.166158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c835b55-7a7b-43ee-91ae-a810f2dd119c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.166683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c835b55-7a7b-43ee-91ae-a810f2dd119c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.167024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c835b55-7a7b-43ee-91ae-a810f2dd119c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.168514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c835b55-7a7b-43ee-91ae-a810f2dd119c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:25.170357 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c835b55-7a7b-43ee-91ae-a810f2dd119c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:25.178118 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 818/1625] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:25.189396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 808/1626] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:25.193060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645488c-92ee-414f-bfc5-4c1aa82e3f47 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:25.195283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c835b55-7a7b-43ee-91ae-a810f2dd119c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:25.210917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c835b55-7a7b-43ee-91ae-a810f2dd119c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:25.220609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645488c-92ee-414f-bfc5-4c1aa82e3f47 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:25.224947 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccce888-6dfb-4249-868e-e3cc97cac512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:25.226894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccce888-6dfb-4249-868e-e3cc97cac512 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.227450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccce888-6dfb-4249-868e-e3cc97cac512 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.228225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccce888-6dfb-4249-868e-e3cc97cac512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.228789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f0cb-2455-4f66-b35f-995f724d0ea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:25.229733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f0cb-2455-4f66-b35f-995f724d0ea5 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.230592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f0cb-2455-4f66-b35f-995f724d0ea5 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.230738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f0cb-2455-4f66-b35f-995f724d0ea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.322630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87f0cb-2455-4f66-b35f-995f724d0ea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:25.324620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87f0cb-2455-4f66-b35f-995f724d0ea5 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:25.329865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccce888-6dfb-4249-868e-e3cc97cac512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:25.333248 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccce888-6dfb-4249-868e-e3cc97cac512 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:25.336627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 819/1627] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:25.338003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f0cb-2455-4f66-b35f-995f724d0ea5 service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:25.357664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f0cb-2455-4f66-b35f-995f724d0ea5 service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:25.362889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cd0b3-475c-474f-b291-57ade8c61e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:25.363830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cd0b3-475c-474f-b291-57ade8c61e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.364254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cd0b3-475c-474f-b291-57ade8c61e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.364802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cd0b3-475c-474f-b291-57ade8c61e07 admin admin] PATH_INFO: `/v3/projects/d3493d0125a147db9fcdf7b347b17b74/users/02f6fc62c8de4b13a42951f605e56dbd/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.367071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cd0b3-475c-474f-b291-57ade8c61e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3493d0125a147db9fcdf7b347b17b74, user_id=02f6fc62c8de4b13a42951f605e56dbd, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:25.369926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cd0b3-475c-474f-b291-57ade8c61e07 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:25.391126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 820/1628] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:25 2022] PUT /identity/v3/projects/d3493d0125a147db9fcdf7b347b17b74/users/02f6fc62c8de4b13a42951f605e56dbd/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:25.391126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cd0b3-475c-474f-b291-57ade8c61e07 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:25.391537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 809/1629] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:25.393101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e702692-b7f7-452c-866d-3343ea88c186 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.393437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e702692-b7f7-452c-866d-3343ea88c186 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.396204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e702692-b7f7-452c-866d-3343ea88c186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.459160 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7e702692-b7f7-452c-866d-3343ea88c186 None None] MFA Rules not processed for user `02f6fc62c8de4b13a42951f605e56dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:25.460437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7e702692-b7f7-452c-866d-3343ea88c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:25.545167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cd0b3-475c-474f-b291-57ade8c61e07 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:25.557197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcee9a1-73d0-427b-844e-80eef9d9ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:25.559525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcee9a1-73d0-427b-844e-80eef9d9ed05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.560377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcee9a1-73d0-427b-844e-80eef9d9ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.560670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcee9a1-73d0-427b-844e-80eef9d9ed05 admin admin] PATH_INFO: `/v3/projects/57ad1932c4fe42d58ca9305fda2415b7/users/9671e60398a34359a05ac4ecda7483e8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.597792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcee9a1-73d0-427b-844e-80eef9d9ed05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ad1932c4fe42d58ca9305fda2415b7, user_id=9671e60398a34359a05ac4ecda7483e8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:25.605459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 810/1630] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:25.605686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcee9a1-73d0-427b-844e-80eef9d9ed05 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:25.620452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e702692-b7f7-452c-866d-3343ea88c186 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:25.635507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 821/1631] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:25 2022] PUT /identity/v3/projects/57ad1932c4fe42d58ca9305fda2415b7/users/9671e60398a34359a05ac4ecda7483e8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:25.640190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcee9a1-73d0-427b-844e-80eef9d9ed05 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:25.728129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e702692-b7f7-452c-866d-3343ea88c186 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:25.729641 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:25.745546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:25.803952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcee9a1-73d0-427b-844e-80eef9d9ed05 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:25.816061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151195e-d3b5-44af-9f36-fce165c0e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:25.818535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151195e-d3b5-44af-9f36-fce165c0e09a admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.818832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151195e-d3b5-44af-9f36-fce165c0e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.819112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151195e-d3b5-44af-9f36-fce165c0e09a admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.821315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151195e-d3b5-44af-9f36-fce165c0e09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:25.826507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151195e-d3b5-44af-9f36-fce165c0e09a admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:25.840215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a723c3c-5703-41ef-be20-88c4fb495556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:25.841037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a723c3c-5703-41ef-be20-88c4fb495556 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.841326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a723c3c-5703-41ef-be20-88c4fb495556 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.842811 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a723c3c-5703-41ef-be20-88c4fb495556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.855124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 822/1632] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:25.855540 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151195e-d3b5-44af-9f36-fce165c0e09a admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:25.951086 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a723c3c-5703-41ef-be20-88c4fb495556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:25.953314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a723c3c-5703-41ef-be20-88c4fb495556 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:25.964823 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 811/1633] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:25.966410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddcb5b-ee56-492d-9447-67fdfe85f4e0 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.966697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddcb5b-ee56-492d-9447-67fdfe85f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.967086 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddcb5b-ee56-492d-9447-67fdfe85f4e0 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.968780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 812/1634] 10.222.0.39 () {54 vars in 912 bytes} [Sat Sep 3 01:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:22:25.969579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddcb5b-ee56-492d-9447-67fdfe85f4e0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:25.985700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddcb5b-ee56-492d-9447-67fdfe85f4e0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:25.993496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b3e4d-9131-4825-acda-e26d687d5815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:25.994344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b3e4d-9131-4825-acda-e26d687d5815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:25.994630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b3e4d-9131-4825-acda-e26d687d5815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:25.995686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b3e4d-9131-4825-acda-e26d687d5815 admin admin] PATH_INFO: `/v3/projects/57ad1932c4fe42d58ca9305fda2415b7/users/9671e60398a34359a05ac4ecda7483e8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:25.998901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b3e4d-9131-4825-acda-e26d687d5815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ad1932c4fe42d58ca9305fda2415b7, user_id=9671e60398a34359a05ac4ecda7483e8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:26.003365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b3e4d-9131-4825-acda-e26d687d5815 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:26.004675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151195e-d3b5-44af-9f36-fce165c0e09a admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:26.018696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31725e-bca9-4131-a012-03d8c3b5864f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:26.019470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31725e-bca9-4131-a012-03d8c3b5864f service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:26.019795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31725e-bca9-4131-a012-03d8c3b5864f service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:26.020104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31725e-bca9-4131-a012-03d8c3b5864f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:26.022321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 813/1635] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:25 2022] PUT /identity/v3/projects/57ad1932c4fe42d58ca9305fda2415b7/users/9671e60398a34359a05ac4ecda7483e8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:26.026002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda513-1ca9-4a20-bd2b-1563a277ddc1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:26.026294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda513-1ca9-4a20-bd2b-1563a277ddc1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:26.026573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda513-1ca9-4a20-bd2b-1563a277ddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:26.085435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b3fda513-1ca9-4a20-bd2b-1563a277ddc1 None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:26.091674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b3fda513-1ca9-4a20-bd2b-1563a277ddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:26.141424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31725e-bca9-4131-a012-03d8c3b5864f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:26.146267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31725e-bca9-4131-a012-03d8c3b5864f service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:26.169624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 823/1636] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:26.170671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd49e-7e53-4ed6-9b7f-401c670a69a7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:26.170939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd49e-7e53-4ed6-9b7f-401c670a69a7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:26.171214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd49e-7e53-4ed6-9b7f-401c670a69a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:26.241208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 814/1637] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:26.242993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec38f85-ddf4-4f5d-a4f6-b896f3fb6801 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:26.242993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec38f85-ddf4-4f5d-a4f6-b896f3fb6801 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:26.243199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec38f85-ddf4-4f5d-a4f6-b896f3fb6801 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:26.244442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 815/1638] 10.222.0.39 () {54 vars in 912 bytes} [Sat Sep 3 01:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:22:26.257112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8d29-ae29-40b2-ad4b-4adb54aefd65 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:26.257516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8d29-ae29-40b2-ad4b-4adb54aefd65 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:26.257773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8d29-ae29-40b2-ad4b-4adb54aefd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:26.275059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-004dd49e-7e53-4ed6-9b7f-401c670a69a7 None None] MFA Rules not processed for user `9671e60398a34359a05ac4ecda7483e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:26.280516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-004dd49e-7e53-4ed6-9b7f-401c670a69a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:26.299814 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ec6d8d29-ae29-40b2-ad4b-4adb54aefd65 None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:26.308017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ec6d8d29-ae29-40b2-ad4b-4adb54aefd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:26.328228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 816/1639] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:26.329231 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8d29-ae29-40b2-ad4b-4adb54aefd65 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:26.394239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:26.422524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:26.432926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 824/1640] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:26.470637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8d29-ae29-40b2-ad4b-4adb54aefd65 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:26.484482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cca54-061d-49f2-8450-dfc5d925cf56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:26.485156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cca54-061d-49f2-8450-dfc5d925cf56 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:26.485442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cca54-061d-49f2-8450-dfc5d925cf56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:26.485717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cca54-061d-49f2-8450-dfc5d925cf56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:26.512638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cca54-061d-49f2-8450-dfc5d925cf56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:26.514654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cca54-061d-49f2-8450-dfc5d925cf56 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:26.539459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 817/1641] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:26.567288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dd49e-7e53-4ed6-9b7f-401c670a69a7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:26.583379 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dd49e-7e53-4ed6-9b7f-401c670a69a7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:26.588745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481fe3-a914-4d67-a9d8-36e6ba15f021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:26.589821 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481fe3-a914-4d67-a9d8-36e6ba15f021 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:26.590201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481fe3-a914-4d67-a9d8-36e6ba15f021 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:26.592081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481fe3-a914-4d67-a9d8-36e6ba15f021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:26.611128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481fe3-a914-4d67-a9d8-36e6ba15f021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:26.614192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481fe3-a914-4d67-a9d8-36e6ba15f021 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:26.650447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 825/1642] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:27.385426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cca54-061d-49f2-8450-dfc5d925cf56 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:27.406325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cca54-061d-49f2-8450-dfc5d925cf56 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:27.417109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329747b6-dc73-46f2-ab0d-74a1fcdd5128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:27.417990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329747b6-dc73-46f2-ab0d-74a1fcdd5128 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:27.418435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329747b6-dc73-46f2-ab0d-74a1fcdd5128 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:27.419748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329747b6-dc73-46f2-ab0d-74a1fcdd5128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:27.456871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329747b6-dc73-46f2-ab0d-74a1fcdd5128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:27.460008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329747b6-dc73-46f2-ab0d-74a1fcdd5128 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:27.486111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 818/1643] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:22:27.578427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481fe3-a914-4d67-a9d8-36e6ba15f021 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:27.808871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481fe3-a914-4d67-a9d8-36e6ba15f021 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:27.844696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14b011-fd0d-4a48-b63e-038e267992e9 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f6fc62c8de4b13a42951f605e56dbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3493d0125a147db9fcdf7b347b17b74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:27.845346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b011-fd0d-4a48-b63e-038e267992e9 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:27.845632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b011-fd0d-4a48-b63e-038e267992e9 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:27.845907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b011-fd0d-4a48-b63e-038e267992e9 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:27.847340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14b011-fd0d-4a48-b63e-038e267992e9 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:27.847340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14b011-fd0d-4a48-b63e-038e267992e9 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:27.848670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14b011-fd0d-4a48-b63e-038e267992e9 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:27.882761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329747b6-dc73-46f2-ab0d-74a1fcdd5128 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:27.888236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 826/1644] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:27.889279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14b011-fd0d-4a48-b63e-038e267992e9 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:27.898105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329747b6-dc73-46f2-ab0d-74a1fcdd5128 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:27.904875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14b011-fd0d-4a48-b63e-038e267992e9 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:27.905668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cccc1-e141-467b-96c7-735ea5f966dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:27.906897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cccc1-e141-467b-96c7-735ea5f966dc service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:27.907433 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cccc1-e141-467b-96c7-735ea5f966dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:27.908077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cccc1-e141-467b-96c7-735ea5f966dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:27.914730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5509731-049c-482e-a98f-a0f58edb7361 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f6fc62c8de4b13a42951f605e56dbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3493d0125a147db9fcdf7b347b17b74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:27.915390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5509731-049c-482e-a98f-a0f58edb7361 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:27.915673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5509731-049c-482e-a98f-a0f58edb7361 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:27.915942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5509731-049c-482e-a98f-a0f58edb7361 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:27.916578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5509731-049c-482e-a98f-a0f58edb7361 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:27.918574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5509731-049c-482e-a98f-a0f58edb7361 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:28.003127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 827/1645] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:27 2022] POST /identity/v3/projects => generated 353 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:22:28.004404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5509731-049c-482e-a98f-a0f58edb7361 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:28.054603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cccc1-e141-467b-96c7-735ea5f966dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:28.057154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cccc1-e141-467b-96c7-735ea5f966dc service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:28.070694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 819/1646] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:22:28.200228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cccc1-e141-467b-96c7-735ea5f966dc service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:28.208076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5509731-049c-482e-a98f-a0f58edb7361 tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:28.221759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a914a3-ac02-4d5e-aa7b-7bbaab25b63d tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f6fc62c8de4b13a42951f605e56dbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3493d0125a147db9fcdf7b347b17b74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:28.223860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a914a3-ac02-4d5e-aa7b-7bbaab25b63d tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:28.224408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a914a3-ac02-4d5e-aa7b-7bbaab25b63d tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:28.226008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a914a3-ac02-4d5e-aa7b-7bbaab25b63d tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:28.228311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a914a3-ac02-4d5e-aa7b-7bbaab25b63d tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:28.231325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a914a3-ac02-4d5e-aa7b-7bbaab25b63d tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:28.235627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a914a3-ac02-4d5e-aa7b-7bbaab25b63d tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:28.265068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 828/1647] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:28.307822 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cccc1-e141-467b-96c7-735ea5f966dc service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:28.349745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a914a3-ac02-4d5e-aa7b-7bbaab25b63d tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:28.370988 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a914a3-ac02-4d5e-aa7b-7bbaab25b63d tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:28.393159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f6fc62c8de4b13a42951f605e56dbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3493d0125a147db9fcdf7b347b17b74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:28.394583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:28.395029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:28.395490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] PATH_INFO: `/v3/projects/1a85a100c1a4451aab25006892e5ea1d` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:28.398628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1a85a100c1a4451aab25006892e5ea1d)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:28.400173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: WARNING py.warnings [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:22:28.400173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: warnings.warn(msg) Sep 03 01:22:28.400173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: Sep 03 01:22:28.401395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:28.460679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:28.462506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:28.463096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:28.463551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] PATH_INFO: `/v3/users/814a076ad8ec41e1ac04ecdef9cee647` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:28.465226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=814a076ad8ec41e1ac04ecdef9cee647)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:28.466537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 01:22:28.466537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 03 01:22:28.466537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: Sep 03 01:22:28.468066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:28.495243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:28.518437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:28.556703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a85a100c1a4451aab25006892e5ea1d', 'request_id': 'req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:28.576586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a85a100c1a4451aab25006892e5ea1d', 'request_id': 'req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:28.596113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a85a100c1a4451aab25006892e5ea1d', 'request_id': 'req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:28.612605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814a076ad8ec41e1ac04ecdef9cee647'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:28.616590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] The token cache is being invalidate because project 1a85a100c1a4451aab25006892e5ea1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:28.617115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:28.618132 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-661f8c6d-4f37-4b0f-a3b4-253a5edc0bfb tempest-VolumeQuotaClassesTest-1940663649 tempest-VolumeQuotaClassesTest-1940663649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:28.629027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 829/1648] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:28 2022] DELETE /identity/v3/projects/1a85a100c1a4451aab25006892e5ea1d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:28.707734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814a076ad8ec41e1ac04ecdef9cee647'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:28.745086 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814a076ad8ec41e1ac04ecdef9cee647'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:28.746607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814a076ad8ec41e1ac04ecdef9cee647'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:28.749278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814a076ad8ec41e1ac04ecdef9cee647'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:28.778695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 820/1649] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:28 2022] DELETE /identity/v3/users/814a076ad8ec41e1ac04ecdef9cee647 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:28.783923 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03c828-19bd-4030-9918-4596d1df0206 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:28.784543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03c828-19bd-4030-9918-4596d1df0206 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:28.784987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03c828-19bd-4030-9918-4596d1df0206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:28.832166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5c03c828-19bd-4030-9918-4596d1df0206 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:28.833828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5c03c828-19bd-4030-9918-4596d1df0206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:28.951192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 830/1650] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:28.983753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:28.986392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:29.214767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fb93b-628a-4895-8c10-7a7a2f572dcb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:29.231782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a6899-be75-41e0-b0e9-7c63a5ce8043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:29.232444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a6899-be75-41e0-b0e9-7c63a5ce8043 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:29.232723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a6899-be75-41e0-b0e9-7c63a5ce8043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:29.233170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a6899-be75-41e0-b0e9-7c63a5ce8043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:29.262045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a6899-be75-41e0-b0e9-7c63a5ce8043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:29.263889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a6899-be75-41e0-b0e9-7c63a5ce8043 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:29.291238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 821/1651] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:22:29.444618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03c828-19bd-4030-9918-4596d1df0206 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:29.447605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5c03c828-19bd-4030-9918-4596d1df0206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:29.467434 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03c828-19bd-4030-9918-4596d1df0206 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:29.480259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:29.481169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:29.481571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:29.481998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] PATH_INFO: `/v3/users/a4fe3e8893db4273b6b097e96e896b2f` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:29.484750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fe3e8893db4273b6b097e96e896b2f)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:29.488257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:29.598881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fe3e8893db4273b6b097e96e896b2f'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:29.626430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fe3e8893db4273b6b097e96e896b2f'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:29.646803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fe3e8893db4273b6b097e96e896b2f'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:29.651739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fe3e8893db4273b6b097e96e896b2f'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:29.652804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fe3e8893db4273b6b097e96e896b2f'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:29.679872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 831/1652] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:29 2022] DELETE /identity/v3/users/a4fe3e8893db4273b6b097e96e896b2f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:29.684967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492d618-33ee-4477-9241-1bda96f2721f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:29.685886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492d618-33ee-4477-9241-1bda96f2721f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:29.686277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492d618-33ee-4477-9241-1bda96f2721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:29.728766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7492d618-33ee-4477-9241-1bda96f2721f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:29.730007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7492d618-33ee-4477-9241-1bda96f2721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:29.934301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 822/1653] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:29.987458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:29.991877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:30.071986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:30.101943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b7dda-70b6-4f9d-9bfb-a55cf1d8a163 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:30.106917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df562dcc-1579-4a61-84ff-f491ebb62f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:30.107980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562dcc-1579-4a61-84ff-f491ebb62f1f service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:30.108437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562dcc-1579-4a61-84ff-f491ebb62f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:30.109105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562dcc-1579-4a61-84ff-f491ebb62f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:30.123005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df562dcc-1579-4a61-84ff-f491ebb62f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:30.124742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df562dcc-1579-4a61-84ff-f491ebb62f1f service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:30.137010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 832/1654] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:30.851979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492d618-33ee-4477-9241-1bda96f2721f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:30.855474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7492d618-33ee-4477-9241-1bda96f2721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:30.873978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492d618-33ee-4477-9241-1bda96f2721f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:30.880537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:30.882149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:30.882572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:30.883041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] PATH_INFO: `/v3/users/5892a5bf77cd4b42a9765199433adf3b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:30.884613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5892a5bf77cd4b42a9765199433adf3b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:30.887506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:30.948886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:30.993687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5892a5bf77cd4b42a9765199433adf3b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:31.017692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5892a5bf77cd4b42a9765199433adf3b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:31.038400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5892a5bf77cd4b42a9765199433adf3b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:31.039343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5892a5bf77cd4b42a9765199433adf3b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:31.039882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5892a5bf77cd4b42a9765199433adf3b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:31.091055 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 823/1655] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:30 2022] DELETE /identity/v3/users/5892a5bf77cd4b42a9765199433adf3b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:31.096515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51196-fe99-4bd6-8fc4-93d42c2f5c18 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:31.096976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51196-fe99-4bd6-8fc4-93d42c2f5c18 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:31.097049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51196-fe99-4bd6-8fc4-93d42c2f5c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:31.141212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-99d51196-fe99-4bd6-8fc4-93d42c2f5c18 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:31.144395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-99d51196-fe99-4bd6-8fc4-93d42c2f5c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:31.236755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 833/1656] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:31.252485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:31.254276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:31.345274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51196-fe99-4bd6-8fc4-93d42c2f5c18 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:31.347220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-99d51196-fe99-4bd6-8fc4-93d42c2f5c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:31.390819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51196-fe99-4bd6-8fc4-93d42c2f5c18 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:31.425377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:31.426782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:31.427333 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:31.427827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] PATH_INFO: `/v3/projects/4ca6aec441ef4c4288dbf5fae8cc6f3f` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:31.431360 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca6aec441ef4c4288dbf5fae8cc6f3f)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:31.434592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:31.480729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4535d3-4b9c-408b-9a65-2733037b65e0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:31.489273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a84ab9-6446-408f-a3a3-f939d9acbdde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:31.493165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a84ab9-6446-408f-a3a3-f939d9acbdde service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:31.493165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a84ab9-6446-408f-a3a3-f939d9acbdde service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:31.493165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a84ab9-6446-408f-a3a3-f939d9acbdde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:31.516604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a84ab9-6446-408f-a3a3-f939d9acbdde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:31.518097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a84ab9-6446-408f-a3a3-f939d9acbdde service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:31.553239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 824/1657] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:31.588023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca6aec441ef4c4288dbf5fae8cc6f3f', 'request_id': 'req-5429d884-1d37-4566-8f09-27dbb36a10ca'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:31.606612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca6aec441ef4c4288dbf5fae8cc6f3f', 'request_id': 'req-5429d884-1d37-4566-8f09-27dbb36a10ca'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:31.625379 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca6aec441ef4c4288dbf5fae8cc6f3f', 'request_id': 'req-5429d884-1d37-4566-8f09-27dbb36a10ca'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:31.692451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] The token cache is being invalidate because project 4ca6aec441ef4c4288dbf5fae8cc6f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:31.693084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:31.694897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5429d884-1d37-4566-8f09-27dbb36a10ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:31.705456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 834/1658] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:31 2022] DELETE /identity/v3/projects/4ca6aec441ef4c4288dbf5fae8cc6f3f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:31.710369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f592db-aefe-4f91-95a2-520b99a17384 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:31.711301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f592db-aefe-4f91-95a2-520b99a17384 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:31.711301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f592db-aefe-4f91-95a2-520b99a17384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:31.791415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d7f592db-aefe-4f91-95a2-520b99a17384 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:31.796511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d7f592db-aefe-4f91-95a2-520b99a17384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:31.945271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 825/1659] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:31.947381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c72826-29c4-4389-ba15-c327c7a16dd4 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:31.948042 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c72826-29c4-4389-ba15-c327c7a16dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:31.948519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c72826-29c4-4389-ba15-c327c7a16dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:31.992407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-c8c72826-29c4-4389-ba15-c327c7a16dd4 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:31.997119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c8c72826-29c4-4389-ba15-c327c7a16dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:32.028854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 835/1660] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:32.034025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f592db-aefe-4f91-95a2-520b99a17384 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:32.044142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f592db-aefe-4f91-95a2-520b99a17384 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:32.059974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ee5fb-3892-4dee-a7a3-e063d57b686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:32.060626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee5fb-3892-4dee-a7a3-e063d57b686d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:32.060916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee5fb-3892-4dee-a7a3-e063d57b686d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:32.061221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee5fb-3892-4dee-a7a3-e063d57b686d admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:32.061839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee5fb-3892-4dee-a7a3-e063d57b686d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:32.062171 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee5fb-3892-4dee-a7a3-e063d57b686d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:32.063822 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee5fb-3892-4dee-a7a3-e063d57b686d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:32.095091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c72826-29c4-4389-ba15-c327c7a16dd4 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:32.101242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 826/1661] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:32.105616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c72826-29c4-4389-ba15-c327c7a16dd4 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:32.119898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076260f-3954-417b-b669-c954774ea834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:32.120540 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076260f-3954-417b-b669-c954774ea834 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:32.120819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076260f-3954-417b-b669-c954774ea834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:32.121221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076260f-3954-417b-b669-c954774ea834 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:32.121810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076260f-3954-417b-b669-c954774ea834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:32.124027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076260f-3954-417b-b669-c954774ea834 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:32.199850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ee5fb-3892-4dee-a7a3-e063d57b686d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:32.208279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 836/1662] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:32 2022] POST /identity/v3/projects => generated 357 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:22:32.211963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ee5fb-3892-4dee-a7a3-e063d57b686d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:32.293358 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:32.354630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4a93b-8f39-492d-8b8e-e94a5a4dfefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:32.355293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4a93b-8f39-492d-8b8e-e94a5a4dfefe admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:32.356033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4a93b-8f39-492d-8b8e-e94a5a4dfefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:32.356033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4a93b-8f39-492d-8b8e-e94a5a4dfefe admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:32.356713 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4a93b-8f39-492d-8b8e-e94a5a4dfefe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:32.358483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4a93b-8f39-492d-8b8e-e94a5a4dfefe admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:32.414158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076260f-3954-417b-b669-c954774ea834 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:32.414350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 827/1663] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:32 2022] POST /identity/v3/users => generated 279 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:32.431065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076260f-3954-417b-b669-c954774ea834 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:32.447812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668691c2-1370-4969-a442-901b7cb3ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:32.449549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668691c2-1370-4969-a442-901b7cb3ce51 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:32.450282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668691c2-1370-4969-a442-901b7cb3ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:32.450762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668691c2-1370-4969-a442-901b7cb3ce51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:32.452197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668691c2-1370-4969-a442-901b7cb3ce51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:32.454204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668691c2-1370-4969-a442-901b7cb3ce51 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:32.485326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4a93b-8f39-492d-8b8e-e94a5a4dfefe admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:32.486005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 837/1664] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:22:32.499908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4a93b-8f39-492d-8b8e-e94a5a4dfefe admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:32.514251 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcf106-4fa4-43b8-8597-524130d17d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:32.515135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf106-4fa4-43b8-8597-524130d17d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:32.515581 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf106-4fa4-43b8-8597-524130d17d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:32.516472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf106-4fa4-43b8-8597-524130d17d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:32.516829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcf106-4fa4-43b8-8597-524130d17d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:32.518631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcf106-4fa4-43b8-8597-524130d17d9e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:32.545685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668691c2-1370-4969-a442-901b7cb3ce51 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:32.557374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 828/1665] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:32.558983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668691c2-1370-4969-a442-901b7cb3ce51 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:32.574444 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff4f2a-ee80-4520-8420-02bdc7ac1dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:32.575491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff4f2a-ee80-4520-8420-02bdc7ac1dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:32.575945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff4f2a-ee80-4520-8420-02bdc7ac1dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:32.576426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff4f2a-ee80-4520-8420-02bdc7ac1dc4 admin admin] PATH_INFO: `/v3/projects/519b2a33ba294c38ad0919aea3787dfa/users/3a69722a22d24e69851791cc4c5e7da4/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:32.609639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff4f2a-ee80-4520-8420-02bdc7ac1dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519b2a33ba294c38ad0919aea3787dfa, user_id=3a69722a22d24e69851791cc4c5e7da4, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:32.613077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff4f2a-ee80-4520-8420-02bdc7ac1dc4 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:32.628614 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:32.636258 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 838/1666] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:32 2022] PUT /identity/v3/projects/519b2a33ba294c38ad0919aea3787dfa/users/3a69722a22d24e69851791cc4c5e7da4/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:22:32.651014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a255312-ed97-4286-b8ba-7ee5a33050bb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:32.652004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a255312-ed97-4286-b8ba-7ee5a33050bb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:32.652004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a255312-ed97-4286-b8ba-7ee5a33050bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:32.714511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9a255312-ed97-4286-b8ba-7ee5a33050bb None None] MFA Rules not processed for user `3a69722a22d24e69851791cc4c5e7da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:32.717087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9a255312-ed97-4286-b8ba-7ee5a33050bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:32.774903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff4f2a-ee80-4520-8420-02bdc7ac1dc4 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:32.777206 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-acff4f2a-ee80-4520-8420-02bdc7ac1dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:32.910031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff4f2a-ee80-4520-8420-02bdc7ac1dc4 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:32.926598 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:32.927519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:32.927956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:32.928378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] PATH_INFO: `/v3/projects/e7c1f8223fad42e6abd04ff44fd8c528` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:32.930100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c1f8223fad42e6abd04ff44fd8c528)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:32.933756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:32.943502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 829/1667] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:32.944736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a255312-ed97-4286-b8ba-7ee5a33050bb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:32.947039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9a255312-ed97-4286-b8ba-7ee5a33050bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:32.975978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a255312-ed97-4286-b8ba-7ee5a33050bb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:32.989338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:32.990195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:32.990565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:32.990932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] PATH_INFO: `/v3/projects/9e45affb8d13416a935486243ad99e21` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:32.995573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e45affb8d13416a935486243ad99e21)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:32.999913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:33.059709 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c1f8223fad42e6abd04ff44fd8c528', 'request_id': 'req-27d266dd-d918-4e1d-9be6-d32a4653b840'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.082843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c1f8223fad42e6abd04ff44fd8c528', 'request_id': 'req-27d266dd-d918-4e1d-9be6-d32a4653b840'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.107199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c1f8223fad42e6abd04ff44fd8c528', 'request_id': 'req-27d266dd-d918-4e1d-9be6-d32a4653b840'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.149049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] The token cache is being invalidate because project e7c1f8223fad42e6abd04ff44fd8c528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:33.153492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.153492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.163632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 839/1668] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:32 2022] DELETE /identity/v3/projects/e7c1f8223fad42e6abd04ff44fd8c528 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:22:33.168232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:33.170110 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:33.178263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e45affb8d13416a935486243ad99e21', 'request_id': 'req-427a75d3-81ed-4a90-914e-b17e175b25d9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.205156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e45affb8d13416a935486243ad99e21', 'request_id': 'req-427a75d3-81ed-4a90-914e-b17e175b25d9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.213897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e45affb8d13416a935486243ad99e21', 'request_id': 'req-427a75d3-81ed-4a90-914e-b17e175b25d9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.236006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] The token cache is being invalidate because project 9e45affb8d13416a935486243ad99e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:33.236445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.237254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-427a75d3-81ed-4a90-914e-b17e175b25d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.238932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 830/1669] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:32 2022] DELETE /identity/v3/projects/9e45affb8d13416a935486243ad99e21 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:33.244426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8aaa6-c208-405c-9d17-9080de5190dc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:33.244829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8aaa6-c208-405c-9d17-9080de5190dc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:33.245207 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8aaa6-c208-405c-9d17-9080de5190dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:33.304783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a5e8aaa6-c208-405c-9d17-9080de5190dc None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:33.318252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a5e8aaa6-c208-405c-9d17-9080de5190dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:33.389080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:33.404461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d266dd-d918-4e1d-9be6-d32a4653b840 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:33.528027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 831/1670] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:33.529209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8aaa6-c208-405c-9d17-9080de5190dc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:33.534419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:33.542979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a5e8aaa6-c208-405c-9d17-9080de5190dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:33.611715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8aaa6-c208-405c-9d17-9080de5190dc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:33.618021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:33.619009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:33.619465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:33.619836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] PATH_INFO: `/v3/users/02f6fc62c8de4b13a42951f605e56dbd` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:33.621345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f6fc62c8de4b13a42951f605e56dbd)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:33.623843 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:33.671465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f2f86-a3f2-451b-9c50-3828ff880902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:33.672113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f2f86-a3f2-451b-9c50-3828ff880902 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:33.677771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f2f86-a3f2-451b-9c50-3828ff880902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:33.678096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f2f86-a3f2-451b-9c50-3828ff880902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:33.681172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f2f86-a3f2-451b-9c50-3828ff880902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:33.688827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f2f86-a3f2-451b-9c50-3828ff880902 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:33.784366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f6fc62c8de4b13a42951f605e56dbd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.828624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 840/1671] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:33 2022] POST /identity/v3/projects => generated 357 bytes in 666 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:33.831442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dca13-6ac9-4c53-b45c-e548d42981cc None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:33.831737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dca13-6ac9-4c53-b45c-e548d42981cc None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:33.832018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dca13-6ac9-4c53-b45c-e548d42981cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:33.847586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f6fc62c8de4b13a42951f605e56dbd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.868715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f6fc62c8de4b13a42951f605e56dbd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.877150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f6fc62c8de4b13a42951f605e56dbd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.880774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f6fc62c8de4b13a42951f605e56dbd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:33.946141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-393dca13-6ac9-4c53-b45c-e548d42981cc None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:33.953094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-393dca13-6ac9-4c53-b45c-e548d42981cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:33.964011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 832/1672] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:33 2022] DELETE /identity/v3/users/02f6fc62c8de4b13a42951f605e56dbd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:33.981380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:33.986391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:34.141060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc208b8-25d5-43cf-9d70-e3ac5a853f80 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:34.149396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6f125-78b8-4840-a657-112d57915fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:34.151501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6f125-78b8-4840-a657-112d57915fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:34.152038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6f125-78b8-4840-a657-112d57915fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:34.152515 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6f125-78b8-4840-a657-112d57915fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:34.153978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6f125-78b8-4840-a657-112d57915fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:34.156912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6f125-78b8-4840-a657-112d57915fa9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:34.175150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 841/1673] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:34.180498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dca13-6ac9-4c53-b45c-e548d42981cc None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:34.181952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-393dca13-6ac9-4c53-b45c-e548d42981cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:34.201788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 833/1674] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:33 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:34.203031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6f125-78b8-4840-a657-112d57915fa9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:34.218796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dca13-6ac9-4c53-b45c-e548d42981cc None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:34.225639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6f125-78b8-4840-a657-112d57915fa9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:34.231432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8035558-ef88-43bb-8ebe-68705b124bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:34.232436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8035558-ef88-43bb-8ebe-68705b124bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:34.232829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8035558-ef88-43bb-8ebe-68705b124bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:34.233426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8035558-ef88-43bb-8ebe-68705b124bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:34.234496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8035558-ef88-43bb-8ebe-68705b124bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:34.235090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8035558-ef88-43bb-8ebe-68705b124bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:34.237344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8035558-ef88-43bb-8ebe-68705b124bb8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:34.239959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:34.240810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:34.241097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:34.241374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] PATH_INFO: `/v3/users/2092b9ad9759438291d34e33878d0d14` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:34.242568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2092b9ad9759438291d34e33878d0d14)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:34.245598 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:34.253970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 834/1675] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:34.255058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8035558-ef88-43bb-8ebe-68705b124bb8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:34.267353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8035558-ef88-43bb-8ebe-68705b124bb8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:34.275046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab38c18-821d-4b04-b388-bbe07b11deed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:34.279540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab38c18-821d-4b04-b388-bbe07b11deed admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:34.281158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab38c18-821d-4b04-b388-bbe07b11deed admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:34.281613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab38c18-821d-4b04-b388-bbe07b11deed admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:34.283588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab38c18-821d-4b04-b388-bbe07b11deed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:34.285489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab38c18-821d-4b04-b388-bbe07b11deed admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:34.320515 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 835/1676] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:34.325370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab38c18-821d-4b04-b388-bbe07b11deed admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:34.346490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:34.357499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2092b9ad9759438291d34e33878d0d14'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:34.361673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab38c18-821d-4b04-b388-bbe07b11deed admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:34.380200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa512a3-7619-4c1d-8426-ad62c9a32220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:34.382904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa512a3-7619-4c1d-8426-ad62c9a32220 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:34.383129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2092b9ad9759438291d34e33878d0d14'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:34.384998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa512a3-7619-4c1d-8426-ad62c9a32220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:34.385831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa512a3-7619-4c1d-8426-ad62c9a32220 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:34.386713 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa512a3-7619-4c1d-8426-ad62c9a32220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:34.392454 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2092b9ad9759438291d34e33878d0d14'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:34.393345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2092b9ad9759438291d34e33878d0d14'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:34.394239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2092b9ad9759438291d34e33878d0d14'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:34.394748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa512a3-7619-4c1d-8426-ad62c9a32220 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:34.424035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 842/1677] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:34 2022] DELETE /identity/v3/users/2092b9ad9759438291d34e33878d0d14 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:34.425317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:34.429223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:34.467230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 836/1678] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:34 2022] POST /identity/v3/projects => generated 405 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:34.475659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90250040-ff24-4520-9cbc-0175fabacae5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:34.475932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90250040-ff24-4520-9cbc-0175fabacae5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:34.476219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90250040-ff24-4520-9cbc-0175fabacae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:34.529209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-90250040-ff24-4520-9cbc-0175fabacae5 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:34.532864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-90250040-ff24-4520-9cbc-0175fabacae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:34.565115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:34.643031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e7d4a-7095-4ed6-b800-6b7e3b5fc6ee admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:34.682889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 837/1679] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:34.686691 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90250040-ff24-4520-9cbc-0175fabacae5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:34.694604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-90250040-ff24-4520-9cbc-0175fabacae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:34.723285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90250040-ff24-4520-9cbc-0175fabacae5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:34.734305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3481b84-bd78-4ecc-ae64-11de290998bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:34.734951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3481b84-bd78-4ecc-ae64-11de290998bf admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:34.735416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3481b84-bd78-4ecc-ae64-11de290998bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:34.735694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3481b84-bd78-4ecc-ae64-11de290998bf admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:34.736435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3481b84-bd78-4ecc-ae64-11de290998bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:34.746352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3481b84-bd78-4ecc-ae64-11de290998bf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:34.794344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 838/1680] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:34 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:34.796263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3481b84-bd78-4ecc-ae64-11de290998bf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:34.797308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d7ce-dcb6-4827-b134-3e72031cc558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:34.798006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d7ce-dcb6-4827-b134-3e72031cc558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:34.798286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d7ce-dcb6-4827-b134-3e72031cc558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:34.798563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d7ce-dcb6-4827-b134-3e72031cc558 admin admin] PATH_INFO: `/v3/projects/973a5f84182d4537b595124d9d882577/users/9738d7de22d34ff8a5f699eb3971f81e/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:34.801344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f3481b84-bd78-4ecc-ae64-11de290998bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:34.829900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9d7ce-dcb6-4827-b134-3e72031cc558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973a5f84182d4537b595124d9d882577, user_id=9738d7de22d34ff8a5f699eb3971f81e, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:34.836297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9d7ce-dcb6-4827-b134-3e72031cc558 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:34.862391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 843/1681] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:34 2022] PUT /identity/v3/projects/973a5f84182d4537b595124d9d882577/users/9738d7de22d34ff8a5f699eb3971f81e/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:34.863350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d7ce-dcb6-4827-b134-3e72031cc558 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:34.923833 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3481b84-bd78-4ecc-ae64-11de290998bf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:35.035313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d7ce-dcb6-4827-b134-3e72031cc558 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:35.040914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d597d08-6ed3-4825-814e-0d873f763f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:35.041784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d597d08-6ed3-4825-814e-0d873f763f4e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:35.042189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d597d08-6ed3-4825-814e-0d873f763f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:35.042702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d597d08-6ed3-4825-814e-0d873f763f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:35.049849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf42b-b494-4d38-8a16-cfff0304b135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:35.050503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf42b-b494-4d38-8a16-cfff0304b135 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:35.050784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf42b-b494-4d38-8a16-cfff0304b135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:35.054764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf42b-b494-4d38-8a16-cfff0304b135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:35.055473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdf42b-b494-4d38-8a16-cfff0304b135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:35.060128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d597d08-6ed3-4825-814e-0d873f763f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:35.062493 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d597d08-6ed3-4825-814e-0d873f763f4e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:35.063352 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdf42b-b494-4d38-8a16-cfff0304b135 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:35.081538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 844/1682] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:35.082750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf42b-b494-4d38-8a16-cfff0304b135 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:35.092927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 839/1683] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:35.095727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d597d08-6ed3-4825-814e-0d873f763f4e service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:35.096548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf42b-b494-4d38-8a16-cfff0304b135 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:35.103168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90c5cc-8c56-4929-aa01-4737b741a876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:35.103901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c5cc-8c56-4929-aa01-4737b741a876 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:35.104182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c5cc-8c56-4929-aa01-4737b741a876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:35.104463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c5cc-8c56-4929-aa01-4737b741a876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:35.105630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90c5cc-8c56-4929-aa01-4737b741a876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:35.108698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90c5cc-8c56-4929-aa01-4737b741a876 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:35.126804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 845/1684] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:35.131266 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90c5cc-8c56-4929-aa01-4737b741a876 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:35.133897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d597d08-6ed3-4825-814e-0d873f763f4e service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:35.145452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90c5cc-8c56-4929-aa01-4737b741a876 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:35.151592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f66c4-8a78-47f8-b384-92b16190b5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:35.152101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f66c4-8a78-47f8-b384-92b16190b5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:35.152451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f66c4-8a78-47f8-b384-92b16190b5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:35.152857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f66c4-8a78-47f8-b384-92b16190b5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:35.153736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f66c4-8a78-47f8-b384-92b16190b5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:35.156579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f66c4-8a78-47f8-b384-92b16190b5c3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:35.168301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8b8d5-1897-483f-8001-4c2729c0d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:35.169258 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8b8d5-1897-483f-8001-4c2729c0d766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:35.169705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8b8d5-1897-483f-8001-4c2729c0d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:35.169994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8b8d5-1897-483f-8001-4c2729c0d766 admin admin] PATH_INFO: `/v3/projects/973a5f84182d4537b595124d9d882577/users/9738d7de22d34ff8a5f699eb3971f81e/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:35.176828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8b8d5-1897-483f-8001-4c2729c0d766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973a5f84182d4537b595124d9d882577, user_id=9738d7de22d34ff8a5f699eb3971f81e, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:35.185429 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8b8d5-1897-483f-8001-4c2729c0d766 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:35.201662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 840/1685] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:35.212167 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f66c4-8a78-47f8-b384-92b16190b5c3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:35.217226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 846/1686] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:35 2022] PUT /identity/v3/projects/973a5f84182d4537b595124d9d882577/users/9738d7de22d34ff8a5f699eb3971f81e/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:35.230748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1b3e-81c9-4f27-a26f-857bf8bcddfb None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:35.231091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1b3e-81c9-4f27-a26f-857bf8bcddfb None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:35.233827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1b3e-81c9-4f27-a26f-857bf8bcddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:35.245478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f66c4-8a78-47f8-b384-92b16190b5c3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:35.272964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:35.302999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-1cdf1b3e-81c9-4f27-a26f-857bf8bcddfb None None] MFA Rules not processed for user `9738d7de22d34ff8a5f699eb3971f81e`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:35.304331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1cdf1b3e-81c9-4f27-a26f-857bf8bcddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:35.386607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:35.394389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764919ce-fafc-439e-a9e2-42b8dd649aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:35.395149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764919ce-fafc-439e-a9e2-42b8dd649aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:35.395458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764919ce-fafc-439e-a9e2-42b8dd649aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:35.395787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764919ce-fafc-439e-a9e2-42b8dd649aa2 admin admin] PATH_INFO: `/v3/projects/fec1fee781c946f7a5fea14aa7214426/users/7f40d62d59bf4133afaed5c37fb66a78/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:35.437551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764919ce-fafc-439e-a9e2-42b8dd649aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec1fee781c946f7a5fea14aa7214426, user_id=7f40d62d59bf4133afaed5c37fb66a78, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:35.445198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764919ce-fafc-439e-a9e2-42b8dd649aa2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:35.479893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 841/1687] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:35 2022] PUT /identity/v3/projects/fec1fee781c946f7a5fea14aa7214426/users/7f40d62d59bf4133afaed5c37fb66a78/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:35.511572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 847/1688] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:35.526729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571dc55-b13a-4fd4-a66b-f61daa3157af None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:35.527075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf1b3e-81c9-4f27-a26f-857bf8bcddfb None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:35.527932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571dc55-b13a-4fd4-a66b-f61daa3157af None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:35.528050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571dc55-b13a-4fd4-a66b-f61daa3157af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:35.528751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1cdf1b3e-81c9-4f27-a26f-857bf8bcddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:35.621200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e571dc55-b13a-4fd4-a66b-f61daa3157af None None] MFA Rules not processed for user `7f40d62d59bf4133afaed5c37fb66a78`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:35.624483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e571dc55-b13a-4fd4-a66b-f61daa3157af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:35.739278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf1b3e-81c9-4f27-a26f-857bf8bcddfb None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:35.801280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 842/1689] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:35.802258 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571dc55-b13a-4fd4-a66b-f61daa3157af None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:35.806579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e571dc55-b13a-4fd4-a66b-f61daa3157af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:35.863871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8313c61-83ed-4602-83f2-0644d029cbb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:35.865654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313c61-83ed-4602-83f2-0644d029cbb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:35.865938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313c61-83ed-4602-83f2-0644d029cbb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:35.866249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313c61-83ed-4602-83f2-0644d029cbb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.038279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571dc55-b13a-4fd4-a66b-f61daa3157af None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:36.052161 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:36.053659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.054143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.054615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] PATH_INFO: `/v3/projects/d3493d0125a147db9fcdf7b347b17b74` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.064488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3493d0125a147db9fcdf7b347b17b74)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:36.067296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:36.089744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8313c61-83ed-4602-83f2-0644d029cbb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:36.104586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8313c61-83ed-4602-83f2-0644d029cbb7 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:36.134338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:36.145640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 848/1690] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:36.146466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8313c61-83ed-4602-83f2-0644d029cbb7 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:36.196543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3493d0125a147db9fcdf7b347b17b74', 'request_id': 'req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:36.206455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8313c61-83ed-4602-83f2-0644d029cbb7 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:36.221353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3493d0125a147db9fcdf7b347b17b74', 'request_id': 'req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:36.236294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3493d0125a147db9fcdf7b347b17b74', 'request_id': 'req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:36.273802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] The token cache is being invalidate because project d3493d0125a147db9fcdf7b347b17b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:36.274099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:36.274972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f56ad38f-4a12-4ec2-9a70-ae7dbb10ace5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:36.282166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 843/1691] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:35 2022] DELETE /identity/v3/projects/d3493d0125a147db9fcdf7b347b17b74 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:36.287744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84006e7a-bb0f-459b-b6da-c907e40cd450 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.288012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84006e7a-bb0f-459b-b6da-c907e40cd450 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.288289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84006e7a-bb0f-459b-b6da-c907e40cd450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.305624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:36.354669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-84006e7a-bb0f-459b-b6da-c907e40cd450 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:36.355922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-84006e7a-bb0f-459b-b6da-c907e40cd450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:36.397080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cda16-bfaf-4409-ab82-79426fed4a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:36.398106 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cda16-bfaf-4409-ab82-79426fed4a9f admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.398609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cda16-bfaf-4409-ab82-79426fed4a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.399059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cda16-bfaf-4409-ab82-79426fed4a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.399901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cda16-bfaf-4409-ab82-79426fed4a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:36.408992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cda16-bfaf-4409-ab82-79426fed4a9f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:36.493187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 844/1692] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:36.494067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84006e7a-bb0f-459b-b6da-c907e40cd450 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:36.495489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-84006e7a-bb0f-459b-b6da-c907e40cd450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:36.535653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 849/1693] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:36 2022] POST /identity/v3/projects => generated 403 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:36.535653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81367-8235-4c46-8667-7cd10d81376d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.535653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81367-8235-4c46-8667-7cd10d81376d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.535653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81367-8235-4c46-8667-7cd10d81376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.585754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-29c81367-8235-4c46-8667-7cd10d81376d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:36.590257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-29c81367-8235-4c46-8667-7cd10d81376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:36.626344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84006e7a-bb0f-459b-b6da-c907e40cd450 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:36.732071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84daec-9dbd-45cb-a8fa-14752262cad2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:36.733194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84daec-9dbd-45cb-a8fa-14752262cad2 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.733979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84daec-9dbd-45cb-a8fa-14752262cad2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.734475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84daec-9dbd-45cb-a8fa-14752262cad2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.736526 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4d84daec-9dbd-45cb-a8fa-14752262cad2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:36.747300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 850/1694] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:36.751673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c81367-8235-4c46-8667-7cd10d81376d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:36.758724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-29c81367-8235-4c46-8667-7cd10d81376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:36.774481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:36.781764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c81367-8235-4c46-8667-7cd10d81376d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:36.794964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd18b-ace8-4d05-b75c-f22643aaee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:36.795622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd18b-ace8-4d05-b75c-f22643aaee3c admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.795899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd18b-ace8-4d05-b75c-f22643aaee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.796173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd18b-ace8-4d05-b75c-f22643aaee3c admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.796835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bd18b-ace8-4d05-b75c-f22643aaee3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:36.804486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bd18b-ace8-4d05-b75c-f22643aaee3c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:36.832249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84daec-9dbd-45cb-a8fa-14752262cad2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:36.833937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84daec-9dbd-45cb-a8fa-14752262cad2 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:36.847667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 845/1695] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:36.849072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84daec-9dbd-45cb-a8fa-14752262cad2 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:36.857888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 851/1696] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:36 2022] POST /identity/v3/users => generated 308 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:36.862450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd18b-ace8-4d05-b75c-f22643aaee3c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:36.866754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84daec-9dbd-45cb-a8fa-14752262cad2 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:36.871993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb31a9-e724-4742-97d9-b6c8225df198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:36.872605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb31a9-e724-4742-97d9-b6c8225df198 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.873078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb31a9-e724-4742-97d9-b6c8225df198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.873350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb31a9-e724-4742-97d9-b6c8225df198 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.874099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb31a9-e724-4742-97d9-b6c8225df198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:36.874472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb31a9-e724-4742-97d9-b6c8225df198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:36.876968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb31a9-e724-4742-97d9-b6c8225df198 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:36.881660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd18b-ace8-4d05-b75c-f22643aaee3c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:36.892440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 846/1697] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:36.898071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb31a9-e724-4742-97d9-b6c8225df198 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:36.902516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62aed0-09f7-4905-9aae-e89068c2fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:36.903200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62aed0-09f7-4905-9aae-e89068c2fd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.903527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62aed0-09f7-4905-9aae-e89068c2fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.903821 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62aed0-09f7-4905-9aae-e89068c2fd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.904476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62aed0-09f7-4905-9aae-e89068c2fd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:36.906231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62aed0-09f7-4905-9aae-e89068c2fd0d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:36.911642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb31a9-e724-4742-97d9-b6c8225df198 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:36.919815 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea972e-dd07-4ac6-86af-442dd6534d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:36.920622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea972e-dd07-4ac6-86af-442dd6534d68 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.920921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea972e-dd07-4ac6-86af-442dd6534d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.921261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea972e-dd07-4ac6-86af-442dd6534d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.922122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea972e-dd07-4ac6-86af-442dd6534d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:36.924133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea972e-dd07-4ac6-86af-442dd6534d68 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:36.936952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 852/1698] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:22:36.940938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62aed0-09f7-4905-9aae-e89068c2fd0d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:36.971585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62aed0-09f7-4905-9aae-e89068c2fd0d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:36.987372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d62ed-86b4-44a9-bcd5-eb0b4f68d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:36.988116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d62ed-86b4-44a9-bcd5-eb0b4f68d338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.988457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d62ed-86b4-44a9-bcd5-eb0b4f68d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.988771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d62ed-86b4-44a9-bcd5-eb0b4f68d338 admin admin] PATH_INFO: `/v3/projects/f2e3db37f06f44279429ce240c7ba01c/users/1cf32b828c1f494eadc425ff56ff0727/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:36.993849 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 847/1699] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:36 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:36.995993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc508eeb-a712-4495-8846-a13a897fae75 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:36.996323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc508eeb-a712-4495-8846-a13a897fae75 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:36.996605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc508eeb-a712-4495-8846-a13a897fae75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:37.025130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d62ed-86b4-44a9-bcd5-eb0b4f68d338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e3db37f06f44279429ce240c7ba01c, user_id=1cf32b828c1f494eadc425ff56ff0727, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:37.029382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d62ed-86b4-44a9-bcd5-eb0b4f68d338 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:37.084650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 853/1700] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:36 2022] PUT /identity/v3/projects/f2e3db37f06f44279429ce240c7ba01c/users/1cf32b828c1f494eadc425ff56ff0727/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:37.087917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d62ed-86b4-44a9-bcd5-eb0b4f68d338 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:37.122062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-dc508eeb-a712-4495-8846-a13a897fae75 None None] MFA Rules not processed for user `07f4d63ddeee4badb517ce829f816fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:37.144753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dc508eeb-a712-4495-8846-a13a897fae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:37.269132 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d62ed-86b4-44a9-bcd5-eb0b4f68d338 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:37.280001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179d8c5-a29b-4d51-a59e-dc6ab41739e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:37.280812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179d8c5-a29b-4d51-a59e-dc6ab41739e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:37.280990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179d8c5-a29b-4d51-a59e-dc6ab41739e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:37.281252 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179d8c5-a29b-4d51-a59e-dc6ab41739e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:37.282373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179d8c5-a29b-4d51-a59e-dc6ab41739e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:37.287077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179d8c5-a29b-4d51-a59e-dc6ab41739e9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:37.329309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:37.347841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 848/1701] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:37.348841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc508eeb-a712-4495-8846-a13a897fae75 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:37.352975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dc508eeb-a712-4495-8846-a13a897fae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:37.365359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 854/1702] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:37 2022] POST /identity/v3/users => generated 295 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:37.367603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179d8c5-a29b-4d51-a59e-dc6ab41739e9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:37.384848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc508eeb-a712-4495-8846-a13a897fae75 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:37.394624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:37.395673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:37.399082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:37.399450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] PATH_INFO: `/v3/projects/c260afe983eb41e6aea078599f155860` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:37.400847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c260afe983eb41e6aea078599f155860)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:37.403475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:37.413052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179d8c5-a29b-4d51-a59e-dc6ab41739e9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:37.439561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48eae0-077a-4c7a-aa9b-49ff789072e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:37.442458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48eae0-077a-4c7a-aa9b-49ff789072e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:37.444013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48eae0-077a-4c7a-aa9b-49ff789072e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:37.445514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48eae0-077a-4c7a-aa9b-49ff789072e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:37.448697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48eae0-077a-4c7a-aa9b-49ff789072e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:37.454413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48eae0-077a-4c7a-aa9b-49ff789072e9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:37.496130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 855/1703] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:37.503167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61260601-e4e1-4c27-a259-99631ca19a4f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:37.506087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61260601-e4e1-4c27-a259-99631ca19a4f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:37.506922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61260601-e4e1-4c27-a259-99631ca19a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:37.540987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c260afe983eb41e6aea078599f155860', 'request_id': 'req-4018f3db-a514-45f9-9e04-dec6ca9215c8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:37.556377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c260afe983eb41e6aea078599f155860', 'request_id': 'req-4018f3db-a514-45f9-9e04-dec6ca9215c8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:37.572788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c260afe983eb41e6aea078599f155860', 'request_id': 'req-4018f3db-a514-45f9-9e04-dec6ca9215c8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:37.575752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-61260601-e4e1-4c27-a259-99631ca19a4f None None] MFA Rules not processed for user `07f4d63ddeee4badb517ce829f816fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:37.578439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-61260601-e4e1-4c27-a259-99631ca19a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:37.603624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] The token cache is being invalidate because project c260afe983eb41e6aea078599f155860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:37.606317 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:37.609129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:37.611025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 849/1704] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:37 2022] DELETE /identity/v3/projects/c260afe983eb41e6aea078599f155860 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:37.620905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:37.624238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:37.640438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:37.838543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 856/1705] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:37.839470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61260601-e4e1-4c27-a259-99631ca19a4f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:37.841278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-61260601-e4e1-4c27-a259-99631ca19a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:37.923836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018f3db-a514-45f9-9e04-dec6ca9215c8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:37.948068 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344bfe7-5de4-446f-b78f-74c4f807bb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:37.948726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344bfe7-5de4-446f-b78f-74c4f807bb22 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:37.949009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344bfe7-5de4-446f-b78f-74c4f807bb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:37.949284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344bfe7-5de4-446f-b78f-74c4f807bb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:37.950016 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344bfe7-5de4-446f-b78f-74c4f807bb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:37.952008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344bfe7-5de4-446f-b78f-74c4f807bb22 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:37.982756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 850/1706] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:37.995395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d58f-c819-44bd-9bb5-74630af634a3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:37.996755 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d58f-c819-44bd-9bb5-74630af634a3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:37.999534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d58f-c819-44bd-9bb5-74630af634a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:38.037808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61260601-e4e1-4c27-a259-99631ca19a4f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:38.058160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0e1fa-66c0-4647-9b13-842474511f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:38.060712 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0e1fa-66c0-4647-9b13-842474511f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:38.060996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0e1fa-66c0-4647-9b13-842474511f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:38.061288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0e1fa-66c0-4647-9b13-842474511f8b admin admin] PATH_INFO: `/v3/projects/f2e3db37f06f44279429ce240c7ba01c/users/1cf32b828c1f494eadc425ff56ff0727/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:38.062831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9fe0d58f-c819-44bd-9bb5-74630af634a3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:38.065475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0e1fa-66c0-4647-9b13-842474511f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e3db37f06f44279429ce240c7ba01c, user_id=1cf32b828c1f494eadc425ff56ff0727, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:38.065998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9fe0d58f-c819-44bd-9bb5-74630af634a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:38.068658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0e1fa-66c0-4647-9b13-842474511f8b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:38.087042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 851/1707] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:38.088756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d58f-c819-44bd-9bb5-74630af634a3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:38.094143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9fe0d58f-c819-44bd-9bb5-74630af634a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:38.103726 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 857/1708] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:37 2022] PUT /identity/v3/projects/f2e3db37f06f44279429ce240c7ba01c/users/1cf32b828c1f494eadc425ff56ff0727/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:38.105064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0e1fa-66c0-4647-9b13-842474511f8b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:38.208704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0e1fa-66c0-4647-9b13-842474511f8b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:38.223640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc91b3-4939-41e6-9370-93d29af92874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:38.224276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc91b3-4939-41e6-9370-93d29af92874 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:38.224552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc91b3-4939-41e6-9370-93d29af92874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:38.224823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc91b3-4939-41e6-9370-93d29af92874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:38.225472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc91b3-4939-41e6-9370-93d29af92874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:38.227292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc91b3-4939-41e6-9370-93d29af92874 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:38.259078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 858/1709] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:38.259078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695582-fd4d-49cd-9a2e-8aa46a5a2ad6 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:38.259078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695582-fd4d-49cd-9a2e-8aa46a5a2ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:38.259078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695582-fd4d-49cd-9a2e-8aa46a5a2ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:38.333863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-69695582-fd4d-49cd-9a2e-8aa46a5a2ad6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:38.335215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-69695582-fd4d-49cd-9a2e-8aa46a5a2ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:38.360250 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 859/1710] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:38.361477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b1fbb-a443-43b3-bfc7-6e375c75210a None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:38.361763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b1fbb-a443-43b3-bfc7-6e375c75210a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:38.362037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b1fbb-a443-43b3-bfc7-6e375c75210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:38.366694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d58f-c819-44bd-9bb5-74630af634a3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:38.417097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:38.460391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-525b1fbb-a443-43b3-bfc7-6e375c75210a None None] MFA Rules not processed for user `1cf32b828c1f494eadc425ff56ff0727`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:38.461769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-525b1fbb-a443-43b3-bfc7-6e375c75210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:38.639958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6529f1-791a-4318-adbc-22ba92cf88be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:38.640650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6529f1-791a-4318-adbc-22ba92cf88be service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:38.641079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6529f1-791a-4318-adbc-22ba92cf88be service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:38.641190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6529f1-791a-4318-adbc-22ba92cf88be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:38.645766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7e6529f1-791a-4318-adbc-22ba92cf88be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:38.730591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 860/1711] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:38.730591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b1fbb-a443-43b3-bfc7-6e375c75210a None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:38.745614 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b1fbb-a443-43b3-bfc7-6e375c75210a None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:38.758534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:38.770342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e4960-37bc-464b-b1c0-e6696f0568a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:38.771425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e4960-37bc-464b-b1c0-e6696f0568a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:38.771883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e4960-37bc-464b-b1c0-e6696f0568a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:38.772366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e4960-37bc-464b-b1c0-e6696f0568a5 admin admin] PATH_INFO: `/v3/projects/e358115dd0fe428a849d6ec8081ae29b/users/bf92d82412b54df382b207009b37388c/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:38.793759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e4960-37bc-464b-b1c0-e6696f0568a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e358115dd0fe428a849d6ec8081ae29b, user_id=bf92d82412b54df382b207009b37388c, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:38.798236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e4960-37bc-464b-b1c0-e6696f0568a5 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:38.812969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6529f1-791a-4318-adbc-22ba92cf88be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:38.816113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6529f1-791a-4318-adbc-22ba92cf88be service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:38.833028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 861/1712] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:38 2022] PUT /identity/v3/projects/e358115dd0fe428a849d6ec8081ae29b/users/bf92d82412b54df382b207009b37388c/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:38.833028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e4960-37bc-464b-b1c0-e6696f0568a5 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:38.838063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 852/1713] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:38.841916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779c629-2ef4-4332-a93a-7d3b9092693c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:38.842234 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779c629-2ef4-4332-a93a-7d3b9092693c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:38.842576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779c629-2ef4-4332-a93a-7d3b9092693c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:38.908188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c779c629-2ef4-4332-a93a-7d3b9092693c None None] MFA Rules not processed for user `9c6321d3fb5d4265aaff699fae301ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:38.909926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c779c629-2ef4-4332-a93a-7d3b9092693c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:38.935983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e4960-37bc-464b-b1c0-e6696f0568a5 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:38.942410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f89d6-3f3e-4924-ab18-0df83193e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:38.943135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f89d6-3f3e-4924-ab18-0df83193e6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:38.943574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f89d6-3f3e-4924-ab18-0df83193e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:38.943849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f89d6-3f3e-4924-ab18-0df83193e6bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:38.944529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f89d6-3f3e-4924-ab18-0df83193e6bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:38.944952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f89d6-3f3e-4924-ab18-0df83193e6bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:38.946503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f89d6-3f3e-4924-ab18-0df83193e6bf admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:38.961492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 862/1714] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:38.963749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f89d6-3f3e-4924-ab18-0df83193e6bf admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:38.967485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-589f89d6-3f3e-4924-ab18-0df83193e6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:39.080233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 853/1715] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:39.081734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45328ed-7ba2-432f-8cf2-b03e5238bf15 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:39.082004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45328ed-7ba2-432f-8cf2-b03e5238bf15 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:39.082274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45328ed-7ba2-432f-8cf2-b03e5238bf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:39.103013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f89d6-3f3e-4924-ab18-0df83193e6bf admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:39.107584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c47c-67fa-4a95-bdb9-07bf86480563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:39.108305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c47c-67fa-4a95-bdb9-07bf86480563 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:39.108652 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c47c-67fa-4a95-bdb9-07bf86480563 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:39.108992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c47c-67fa-4a95-bdb9-07bf86480563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:39.138100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:39.153144 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d45328ed-7ba2-432f-8cf2-b03e5238bf15 None None] MFA Rules not processed for user `bf92d82412b54df382b207009b37388c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:39.155037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d45328ed-7ba2-432f-8cf2-b03e5238bf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:39.219795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1c47c-67fa-4a95-bdb9-07bf86480563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:39.222377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1c47c-67fa-4a95-bdb9-07bf86480563 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:39.240677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 863/1716] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:38 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:39.242227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c47c-67fa-4a95-bdb9-07bf86480563 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:39.255787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c47c-67fa-4a95-bdb9-07bf86480563 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:39.261977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671849b-afdd-47bf-bf48-9846854da135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:39.262995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671849b-afdd-47bf-bf48-9846854da135 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:39.263447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671849b-afdd-47bf-bf48-9846854da135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:39.263877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671849b-afdd-47bf-bf48-9846854da135 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:39.266664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671849b-afdd-47bf-bf48-9846854da135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:39.275940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671849b-afdd-47bf-bf48-9846854da135 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:39.345085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 854/1717] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:39.346917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45328ed-7ba2-432f-8cf2-b03e5238bf15 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:39.349255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d45328ed-7ba2-432f-8cf2-b03e5238bf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:39.381796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 864/1718] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:39 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:39.384143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671849b-afdd-47bf-bf48-9846854da135 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:39.560885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:39.648192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671849b-afdd-47bf-bf48-9846854da135 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:39.655638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba42b2-da81-42dc-aad0-f0b26f879a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:39.657928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba42b2-da81-42dc-aad0-f0b26f879a80 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:39.659393 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba42b2-da81-42dc-aad0-f0b26f879a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:39.659878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba42b2-da81-42dc-aad0-f0b26f879a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:39.661167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba42b2-da81-42dc-aad0-f0b26f879a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:39.663735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba42b2-da81-42dc-aad0-f0b26f879a80 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:39.668560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45328ed-7ba2-432f-8cf2-b03e5238bf15 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:39.774102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 865/1719] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:39 2022] POST /identity/v3/projects => generated 389 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:39.780696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba42b2-da81-42dc-aad0-f0b26f879a80 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:39.955297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2efb4e-6dc0-4b06-8b43-8885889a4899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:39.956275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2efb4e-6dc0-4b06-8b43-8885889a4899 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:39.956759 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2efb4e-6dc0-4b06-8b43-8885889a4899 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:39.957490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2efb4e-6dc0-4b06-8b43-8885889a4899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:39.969180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba42b2-da81-42dc-aad0-f0b26f879a80 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:39.974413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23043e-2ad0-462c-b623-8e896bc74c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:39.974991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23043e-2ad0-462c-b623-8e896bc74c3e admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:39.975401 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23043e-2ad0-462c-b623-8e896bc74c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:39.975676 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23043e-2ad0-462c-b623-8e896bc74c3e admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:39.976548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23043e-2ad0-462c-b623-8e896bc74c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:39.978872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23043e-2ad0-462c-b623-8e896bc74c3e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:40.027562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 866/1720] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:39 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:40.028653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23043e-2ad0-462c-b623-8e896bc74c3e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:40.051806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23043e-2ad0-462c-b623-8e896bc74c3e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:40.060081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:40.060768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.061052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.061313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] PATH_INFO: `/v3/users/7f40d62d59bf4133afaed5c37fb66a78` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.062786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f40d62d59bf4133afaed5c37fb66a78)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:40.066251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:40.068365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:40.145733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2efb4e-6dc0-4b06-8b43-8885889a4899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:40.150626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2efb4e-6dc0-4b06-8b43-8885889a4899 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:40.180626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f40d62d59bf4133afaed5c37fb66a78'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:40.184547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 855/1721] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 839 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:40.186711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2efb4e-6dc0-4b06-8b43-8885889a4899 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:40.212176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2efb4e-6dc0-4b06-8b43-8885889a4899 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:40.213745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f40d62d59bf4133afaed5c37fb66a78'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:40.232224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f718be3-f635-4965-b61a-e51ff4f1cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:40.234653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f718be3-f635-4965-b61a-e51ff4f1cefe admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.234653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f718be3-f635-4965-b61a-e51ff4f1cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.234653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f718be3-f635-4965-b61a-e51ff4f1cefe admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.235485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f718be3-f635-4965-b61a-e51ff4f1cefe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:40.236227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f40d62d59bf4133afaed5c37fb66a78'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:40.237471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f40d62d59bf4133afaed5c37fb66a78'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:40.238347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f40d62d59bf4133afaed5c37fb66a78'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:40.240150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f718be3-f635-4965-b61a-e51ff4f1cefe admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:40.277248 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 867/1722] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:40 2022] DELETE /identity/v3/users/7f40d62d59bf4133afaed5c37fb66a78 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:40.278477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:40.284743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 856/1723] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:40 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:40.286295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8af5f-f201-4164-9638-d896efdd0eb1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.287621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8af5f-f201-4164-9638-d896efdd0eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.288736 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:40.290521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8af5f-f201-4164-9638-d896efdd0eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.352199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4ab8af5f-f201-4164-9638-d896efdd0eb1 None None] MFA Rules not processed for user `1d959b149003454c83105a7ed6ad7003`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:40.353892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4ab8af5f-f201-4164-9638-d896efdd0eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:40.449455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:40.456189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9096e8-3d6f-4390-927a-32e1a9086aad admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:40.470768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 857/1724] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:40.472430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8f1a7-c311-436d-9430-7431670930a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:40.472583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c30e3-85d8-449d-9a10-751b42675e16 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.472856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c30e3-85d8-449d-9a10-751b42675e16 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.475397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8f1a7-c311-436d-9430-7431670930a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.476189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8f1a7-c311-436d-9430-7431670930a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.476494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c30e3-85d8-449d-9a10-751b42675e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.480563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8f1a7-c311-436d-9430-7431670930a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.481784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8f1a7-c311-436d-9430-7431670930a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:40.487603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8f1a7-c311-436d-9430-7431670930a5 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:40.521745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6a9c30e3-85d8-449d-9a10-751b42675e16 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:40.523612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6a9c30e3-85d8-449d-9a10-751b42675e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:40.541950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 868/1725] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:40.544383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8f1a7-c311-436d-9430-7431670930a5 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:40.547385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-73b8f1a7-c311-436d-9430-7431670930a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:40.564292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 858/1726] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:40.573392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525dc5-ef3c-4418-bb74-cdbb7c823fb5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.573940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525dc5-ef3c-4418-bb74-cdbb7c823fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.574387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525dc5-ef3c-4418-bb74-cdbb7c823fb5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.577116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 859/1727] 10.222.0.39 () {54 vars in 912 bytes} [Sat Sep 3 01:22:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:22:40.579195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67525dc5-ef3c-4418-bb74-cdbb7c823fb5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:40.584578 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-67525dc5-ef3c-4418-bb74-cdbb7c823fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:40.607750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8f1a7-c311-436d-9430-7431670930a5 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:40.627660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5443487-1928-45e3-9509-0b927a0338ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:40.631527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5443487-1928-45e3-9509-0b927a0338ed admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.632026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5443487-1928-45e3-9509-0b927a0338ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.632314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5443487-1928-45e3-9509-0b927a0338ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.634087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5443487-1928-45e3-9509-0b927a0338ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:40.637953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5443487-1928-45e3-9509-0b927a0338ed admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:40.660343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 869/1728] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:40.661439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5443487-1928-45e3-9509-0b927a0338ed admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:40.693113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5443487-1928-45e3-9509-0b927a0338ed admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:40.698353 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f54392-559d-4709-ad0c-9ebd036b5996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:40.698976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54392-559d-4709-ad0c-9ebd036b5996 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.699381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54392-559d-4709-ad0c-9ebd036b5996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.699664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54392-559d-4709-ad0c-9ebd036b5996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.711801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f54392-559d-4709-ad0c-9ebd036b5996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:40.713835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f54392-559d-4709-ad0c-9ebd036b5996 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:40.755002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 870/1729] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:40.758795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f54392-559d-4709-ad0c-9ebd036b5996 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:40.761584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-27f54392-559d-4709-ad0c-9ebd036b5996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:40.813999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67525dc5-ef3c-4418-bb74-cdbb7c823fb5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:40.834818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510c399-1bad-46ca-89ce-bb02c5ec4c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:40.836106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510c399-1bad-46ca-89ce-bb02c5ec4c02 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.836445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510c399-1bad-46ca-89ce-bb02c5ec4c02 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.836727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510c399-1bad-46ca-89ce-bb02c5ec4c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.874208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510c399-1bad-46ca-89ce-bb02c5ec4c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:40.876251 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510c399-1bad-46ca-89ce-bb02c5ec4c02 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:40.889942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 860/1730] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:40.891500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390a73-26e9-4889-bc89-f8ab4d2f431a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.891848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390a73-26e9-4889-bc89-f8ab4d2f431a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.892060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390a73-26e9-4889-bc89-f8ab4d2f431a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.964221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f54392-559d-4709-ad0c-9ebd036b5996 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:40.979202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df80e3-f2df-4c44-8669-5213c37a3e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:40.980127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df80e3-f2df-4c44-8669-5213c37a3e5c service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:40.980304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df80e3-f2df-4c44-8669-5213c37a3e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:40.980666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df80e3-f2df-4c44-8669-5213c37a3e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:40.986563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c5390a73-26e9-4889-bc89-f8ab4d2f431a None None] MFA Rules not processed for user `8bec5c8c626c40ef9906783916c49dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:40.988133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c5390a73-26e9-4889-bc89-f8ab4d2f431a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:41.000919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:41.006375 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 861/1731] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:41.006784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df80e3-f2df-4c44-8669-5213c37a3e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:41.008984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df80e3-f2df-4c44-8669-5213c37a3e5c service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:41.012999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5390a73-26e9-4889-bc89-f8ab4d2f431a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:41.032470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5390a73-26e9-4889-bc89-f8ab4d2f431a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:41.032644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 871/1732] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:41.034278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df80e3-f2df-4c44-8669-5213c37a3e5c service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:41.049007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ff103-cbc5-4bf5-9a26-0a7d120f1f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:41.050928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff103-cbc5-4bf5-9a26-0a7d120f1f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:41.051387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff103-cbc5-4bf5-9a26-0a7d120f1f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:41.053432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff103-cbc5-4bf5-9a26-0a7d120f1f82 admin admin] PATH_INFO: `/v3/projects/080849298af641ddaa38e912b6d3dccf/users/9d4c6139836c4a2ead59d8fd93ed8923/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:41.058327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df80e3-f2df-4c44-8669-5213c37a3e5c service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:41.073298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b101e4-7b27-4713-8288-bf9c4f979046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:41.074432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b101e4-7b27-4713-8288-bf9c4f979046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:41.075351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b101e4-7b27-4713-8288-bf9c4f979046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:41.075831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b101e4-7b27-4713-8288-bf9c4f979046 admin admin] PATH_INFO: `/v3/projects/8891b5db8360468dbd2418b42dc8cc5d/users/08d90968210a4d7c98dad8a12f4b0717/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:41.089173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ff103-cbc5-4bf5-9a26-0a7d120f1f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080849298af641ddaa38e912b6d3dccf, user_id=9d4c6139836c4a2ead59d8fd93ed8923, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:41.096705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ff103-cbc5-4bf5-9a26-0a7d120f1f82 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:41.110800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b101e4-7b27-4713-8288-bf9c4f979046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8891b5db8360468dbd2418b42dc8cc5d, user_id=08d90968210a4d7c98dad8a12f4b0717, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:41.125446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 862/1733] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:41 2022] PUT /identity/v3/projects/080849298af641ddaa38e912b6d3dccf/users/9d4c6139836c4a2ead59d8fd93ed8923/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:41.127286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ff103-cbc5-4bf5-9a26-0a7d120f1f82 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:41.127421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b101e4-7b27-4713-8288-bf9c4f979046 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:41.156433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 872/1734] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:41 2022] PUT /identity/v3/projects/8891b5db8360468dbd2418b42dc8cc5d/users/08d90968210a4d7c98dad8a12f4b0717/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:41.162992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b101e4-7b27-4713-8288-bf9c4f979046 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:41.305498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ff103-cbc5-4bf5-9a26-0a7d120f1f82 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:41.338353 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b101e4-7b27-4713-8288-bf9c4f979046 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:41.345147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a3caa-4aeb-40fe-8784-29cf670ef154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:41.345834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a3caa-4aeb-40fe-8784-29cf670ef154 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:41.346123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a3caa-4aeb-40fe-8784-29cf670ef154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:41.347834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a3caa-4aeb-40fe-8784-29cf670ef154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:41.369602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a3caa-4aeb-40fe-8784-29cf670ef154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:41.373966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:41.375910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a3caa-4aeb-40fe-8784-29cf670ef154 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:41.404951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 873/1735] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:41.408963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30d936-b0d8-4be2-955e-cea864b52415 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:41.410366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30d936-b0d8-4be2-955e-cea864b52415 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:41.410677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30d936-b0d8-4be2-955e-cea864b52415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:41.415200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e64a0-1475-45b8-8d3d-805dc8148354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:41.416070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e64a0-1475-45b8-8d3d-805dc8148354 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:41.416453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e64a0-1475-45b8-8d3d-805dc8148354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:41.417204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e64a0-1475-45b8-8d3d-805dc8148354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:41.418818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e64a0-1475-45b8-8d3d-805dc8148354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:41.421501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e64a0-1475-45b8-8d3d-805dc8148354 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:41.440309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 863/1736] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:41.441808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e64a0-1475-45b8-8d3d-805dc8148354 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:41.454672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e64a0-1475-45b8-8d3d-805dc8148354 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:41.461851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cb66a-f79e-4076-bc1b-9466c0938e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:41.462604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb66a-f79e-4076-bc1b-9466c0938e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:41.463053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb66a-f79e-4076-bc1b-9466c0938e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:41.463455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb66a-f79e-4076-bc1b-9466c0938e3f admin admin] PATH_INFO: `/v3/projects/080849298af641ddaa38e912b6d3dccf/users/9d4c6139836c4a2ead59d8fd93ed8923/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:41.466592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cb66a-f79e-4076-bc1b-9466c0938e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=080849298af641ddaa38e912b6d3dccf, user_id=9d4c6139836c4a2ead59d8fd93ed8923, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:41.470902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cb66a-f79e-4076-bc1b-9466c0938e3f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:41.494979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 864/1737] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:41 2022] PUT /identity/v3/projects/080849298af641ddaa38e912b6d3dccf/users/9d4c6139836c4a2ead59d8fd93ed8923/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:41.497564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a43a4-8edb-46ef-96ca-cdfb1bf877e9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:41.500236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a43a4-8edb-46ef-96ca-cdfb1bf877e9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:41.500772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a43a4-8edb-46ef-96ca-cdfb1bf877e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:41.526007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3b30d936-b0d8-4be2-955e-cea864b52415 None None] MFA Rules not processed for user `08d90968210a4d7c98dad8a12f4b0717`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:41.536631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3b30d936-b0d8-4be2-955e-cea864b52415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:41.546094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2b9a43a4-8edb-46ef-96ca-cdfb1bf877e9 None None] MFA Rules not processed for user `9d4c6139836c4a2ead59d8fd93ed8923`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:41.550513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b9a43a4-8edb-46ef-96ca-cdfb1bf877e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:41.808094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 874/1738] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:41.811201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30d936-b0d8-4be2-955e-cea864b52415 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:41.834577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 865/1739] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:41.839752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a43a4-8edb-46ef-96ca-cdfb1bf877e9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:41.847749 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b9a43a4-8edb-46ef-96ca-cdfb1bf877e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:42.020820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30d936-b0d8-4be2-955e-cea864b52415 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:42.032850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c25842-2b09-4c6b-8d9c-0dd233473714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:42.033065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25842-2b09-4c6b-8d9c-0dd233473714 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:42.033306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25842-2b09-4c6b-8d9c-0dd233473714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:42.034190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25842-2b09-4c6b-8d9c-0dd233473714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:42.034290 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c25842-2b09-4c6b-8d9c-0dd233473714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:42.037182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c25842-2b09-4c6b-8d9c-0dd233473714 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:42.040710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a43a4-8edb-46ef-96ca-cdfb1bf877e9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:42.056051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5181bc-818b-40d2-a435-724206e0bc20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:42.057042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5181bc-818b-40d2-a435-724206e0bc20 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:42.057334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5181bc-818b-40d2-a435-724206e0bc20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:42.057994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5181bc-818b-40d2-a435-724206e0bc20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:42.066138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:42.078331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5181bc-818b-40d2-a435-724206e0bc20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:42.083566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5181bc-818b-40d2-a435-724206e0bc20 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:42.095938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 875/1740] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:41 2022] POST /identity/v3/projects => generated 383 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:42.100501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c25842-2b09-4c6b-8d9c-0dd233473714 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:42.125223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 866/1741] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:42.239439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c25842-2b09-4c6b-8d9c-0dd233473714 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:42.253915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464d1a7-641d-46a4-84f0-731aeb33da7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:42.254873 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464d1a7-641d-46a4-84f0-731aeb33da7b admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:42.255943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464d1a7-641d-46a4-84f0-731aeb33da7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:42.259194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464d1a7-641d-46a4-84f0-731aeb33da7b admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:42.268706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464d1a7-641d-46a4-84f0-731aeb33da7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:42.273114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464d1a7-641d-46a4-84f0-731aeb33da7b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:42.310741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 876/1742] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:42 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:42.315121 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5181bc-818b-40d2-a435-724206e0bc20 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:42.330018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5181bc-818b-40d2-a435-724206e0bc20 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:42.343703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cea50f-b2c1-4a6a-8e6a-b56f4a0ec41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:42.346267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cea50f-b2c1-4a6a-8e6a-b56f4a0ec41a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:42.346612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cea50f-b2c1-4a6a-8e6a-b56f4a0ec41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:42.347148 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cea50f-b2c1-4a6a-8e6a-b56f4a0ec41a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:42.348383 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cea50f-b2c1-4a6a-8e6a-b56f4a0ec41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:42.360889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cea50f-b2c1-4a6a-8e6a-b56f4a0ec41a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:42.425368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 867/1743] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:42.429720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464d1a7-641d-46a4-84f0-731aeb33da7b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:42.443393 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464d1a7-641d-46a4-84f0-731aeb33da7b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:42.455579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cea50f-b2c1-4a6a-8e6a-b56f4a0ec41a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:42.470745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443afae0-09ee-49c6-8611-68a374d53af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:42.475358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443afae0-09ee-49c6-8611-68a374d53af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:42.476097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443afae0-09ee-49c6-8611-68a374d53af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:42.476230 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443afae0-09ee-49c6-8611-68a374d53af1 admin admin] PATH_INFO: `/v3/projects/ba17e169e69a401bb01c40ebdc4cac36/users/36a814d6c053402885ef85fc374b0a19/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:42.491887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cea50f-b2c1-4a6a-8e6a-b56f4a0ec41a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:42.508300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:42.508969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:42.509249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:42.509523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] PATH_INFO: `/v3/users/bf92d82412b54df382b207009b37388c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:42.512489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443afae0-09ee-49c6-8611-68a374d53af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba17e169e69a401bb01c40ebdc4cac36, user_id=36a814d6c053402885ef85fc374b0a19, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:42.516583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443afae0-09ee-49c6-8611-68a374d53af1 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:42.520223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf92d82412b54df382b207009b37388c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:42.530456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:42.560639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 877/1744] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:42 2022] PUT /identity/v3/projects/ba17e169e69a401bb01c40ebdc4cac36/users/36a814d6c053402885ef85fc374b0a19/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:42.564525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443afae0-09ee-49c6-8611-68a374d53af1 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:42.626974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:42.685649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf92d82412b54df382b207009b37388c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:42.730300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf92d82412b54df382b207009b37388c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:42.735806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443afae0-09ee-49c6-8611-68a374d53af1 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:42.744409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf92d82412b54df382b207009b37388c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:42.745366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf92d82412b54df382b207009b37388c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:42.746966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-485dd6e7-1dbf-442a-8e62-51642a87361e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf92d82412b54df382b207009b37388c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:42.764510 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14947fb4-9cb3-407b-9184-5d539b7938f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:42.765351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947fb4-9cb3-407b-9184-5d539b7938f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:42.765911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947fb4-9cb3-407b-9184-5d539b7938f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:42.766386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947fb4-9cb3-407b-9184-5d539b7938f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:42.767089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14947fb4-9cb3-407b-9184-5d539b7938f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:42.773537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14947fb4-9cb3-407b-9184-5d539b7938f2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:42.795457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 878/1745] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:42.800741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14947fb4-9cb3-407b-9184-5d539b7938f2 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:42.803716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-14947fb4-9cb3-407b-9184-5d539b7938f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:42.808932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 868/1746] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:42 2022] DELETE /identity/v3/users/bf92d82412b54df382b207009b37388c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:42.813573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963e9d3-f36a-4167-9b0c-6e5297912f5d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:42.814751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963e9d3-f36a-4167-9b0c-6e5297912f5d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:42.815029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963e9d3-f36a-4167-9b0c-6e5297912f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:42.837271 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14947fb4-9cb3-407b-9184-5d539b7938f2 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:42.886414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6963e9d3-f36a-4167-9b0c-6e5297912f5d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:42.893458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6963e9d3-f36a-4167-9b0c-6e5297912f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:42.968143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:42.988874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da83e84-949f-4abb-bb52-c5edf006da3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:42.989685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da83e84-949f-4abb-bb52-c5edf006da3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:42.990150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da83e84-949f-4abb-bb52-c5edf006da3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:42.990800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da83e84-949f-4abb-bb52-c5edf006da3a admin admin] PATH_INFO: `/v3/projects/ba17e169e69a401bb01c40ebdc4cac36/users/36a814d6c053402885ef85fc374b0a19/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:42.994789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da83e84-949f-4abb-bb52-c5edf006da3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba17e169e69a401bb01c40ebdc4cac36, user_id=36a814d6c053402885ef85fc374b0a19, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:43.002594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da83e84-949f-4abb-bb52-c5edf006da3a admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:43.041301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 879/1747] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:42 2022] PUT /identity/v3/projects/ba17e169e69a401bb01c40ebdc4cac36/users/36a814d6c053402885ef85fc374b0a19/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:22:43.052511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3250cdc-d244-4b22-97a0-15c8ab216466 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:43.054151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3250cdc-d244-4b22-97a0-15c8ab216466 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:43.054704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3250cdc-d244-4b22-97a0-15c8ab216466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:43.112942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 869/1748] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:43.114073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963e9d3-f36a-4167-9b0c-6e5297912f5d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:43.117257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6963e9d3-f36a-4167-9b0c-6e5297912f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:43.139666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-c3250cdc-d244-4b22-97a0-15c8ab216466 None None] MFA Rules not processed for user `36a814d6c053402885ef85fc374b0a19`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:43.142067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c3250cdc-d244-4b22-97a0-15c8ab216466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:43.147893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963e9d3-f36a-4167-9b0c-6e5297912f5d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:43.278573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:43.279275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:43.281918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:43.284569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] PATH_INFO: `/v3/projects/fec1fee781c946f7a5fea14aa7214426` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:43.287761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec1fee781c946f7a5fea14aa7214426)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:43.289800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:43.305891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 880/1749] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:22:43.310344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3250cdc-d244-4b22-97a0-15c8ab216466 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:43.312321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c3250cdc-d244-4b22-97a0-15c8ab216466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:43.432102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec1fee781c946f7a5fea14aa7214426', 'request_id': 'req-9c68ba8b-12a7-43ec-956b-0088b72de2d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:43.444487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:43.457778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec1fee781c946f7a5fea14aa7214426', 'request_id': 'req-9c68ba8b-12a7-43ec-956b-0088b72de2d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:43.472487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec1fee781c946f7a5fea14aa7214426', 'request_id': 'req-9c68ba8b-12a7-43ec-956b-0088b72de2d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:43.486558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3250cdc-d244-4b22-97a0-15c8ab216466 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:43.495228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] The token cache is being invalidate because project fec1fee781c946f7a5fea14aa7214426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:43.495550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:43.499021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:43.505736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 870/1750] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:43 2022] DELETE /identity/v3/projects/fec1fee781c946f7a5fea14aa7214426 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:43.508185 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:43.513907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:43.649892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452fd22-bcd4-4287-8d09-b3efb66beba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:43.650525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452fd22-bcd4-4287-8d09-b3efb66beba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:43.650809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452fd22-bcd4-4287-8d09-b3efb66beba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:43.651086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452fd22-bcd4-4287-8d09-b3efb66beba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:43.667108 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1452fd22-bcd4-4287-8d09-b3efb66beba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:43.738600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ba8b-12a7-43ec-956b-0088b72de2d3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:43.748418 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b14c4-bc37-4da3-b8f0-00441838e534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:43.804736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b14c4-bc37-4da3-b8f0-00441838e534 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:43.807692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b14c4-bc37-4da3-b8f0-00441838e534 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:43.809376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b14c4-bc37-4da3-b8f0-00441838e534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:43.819084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-af3b14c4-bc37-4da3-b8f0-00441838e534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:43.836746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:43.908428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452fd22-bcd4-4287-8d09-b3efb66beba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:43.909922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452fd22-bcd4-4287-8d09-b3efb66beba4 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:43.943220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 881/1751] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:43.944069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452fd22-bcd4-4287-8d09-b3efb66beba4 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:43.951403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1452fd22-bcd4-4287-8d09-b3efb66beba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:43.978882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452fd22-bcd4-4287-8d09-b3efb66beba4 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:43.992684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:43.993350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:43.993624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:43.993897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] PATH_INFO: `/v3/users/1cf32b828c1f494eadc425ff56ff0727` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:43.997816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf32b828c1f494eadc425ff56ff0727)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:43.998692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:44.013210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b14c4-bc37-4da3-b8f0-00441838e534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:44.015541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b14c4-bc37-4da3-b8f0-00441838e534 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:44.041235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 871/1752] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:44.042452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b14c4-bc37-4da3-b8f0-00441838e534 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:44.047106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-af3b14c4-bc37-4da3-b8f0-00441838e534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:44.120545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf32b828c1f494eadc425ff56ff0727'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:44.157825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf32b828c1f494eadc425ff56ff0727'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:44.164109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf32b828c1f494eadc425ff56ff0727'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:44.164109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf32b828c1f494eadc425ff56ff0727'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:44.164903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf32b828c1f494eadc425ff56ff0727'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:44.190469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 882/1753] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:43 2022] DELETE /identity/v3/users/1cf32b828c1f494eadc425ff56ff0727 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:44.225989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b14c4-bc37-4da3-b8f0-00441838e534 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:44.278655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:44.320103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d29b65-6a77-46c3-95d5-51aa5108ed08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:44.320829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d29b65-6a77-46c3-95d5-51aa5108ed08 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:44.321417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d29b65-6a77-46c3-95d5-51aa5108ed08 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:44.321769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d29b65-6a77-46c3-95d5-51aa5108ed08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:44.325425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f1d29b65-6a77-46c3-95d5-51aa5108ed08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:44.358288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d29b65-6a77-46c3-95d5-51aa5108ed08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:44.360882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d29b65-6a77-46c3-95d5-51aa5108ed08 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:44.395421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 872/1754] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:45.581582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:45.583629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:45.708541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d29b65-6a77-46c3-95d5-51aa5108ed08 service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:45.711030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f1d29b65-6a77-46c3-95d5-51aa5108ed08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:45.728108 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac696ca-6d76-4e66-b055-d6dffcef3133 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:45.736793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d29b65-6a77-46c3-95d5-51aa5108ed08 service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:45.749264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:45.750173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:45.752130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:45.752803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:45.753093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:45.753365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] PATH_INFO: `/v3/projects/e358115dd0fe428a849d6ec8081ae29b` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:45.754794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e358115dd0fe428a849d6ec8081ae29b)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:45.754887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:45.755494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] PATH_INFO: `/v3/projects/f2e3db37f06f44279429ce240c7ba01c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:45.757000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:45.759113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e3db37f06f44279429ce240c7ba01c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:45.766715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:45.877477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e358115dd0fe428a849d6ec8081ae29b', 'request_id': 'req-c162c311-75e7-4560-8b3a-425a371cb08a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:45.884284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:45.896066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e3db37f06f44279429ce240c7ba01c', 'request_id': 'req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:45.909625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e358115dd0fe428a849d6ec8081ae29b', 'request_id': 'req-c162c311-75e7-4560-8b3a-425a371cb08a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:45.920487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e3db37f06f44279429ce240c7ba01c', 'request_id': 'req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:45.928491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e358115dd0fe428a849d6ec8081ae29b', 'request_id': 'req-c162c311-75e7-4560-8b3a-425a371cb08a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:45.945789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e3db37f06f44279429ce240c7ba01c', 'request_id': 'req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:45.971373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] The token cache is being invalidate because project e358115dd0fe428a849d6ec8081ae29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:45.971990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:45.972923 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-c162c311-75e7-4560-8b3a-425a371cb08a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:45.984451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 883/1755] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:45 2022] DELETE /identity/v3/projects/e358115dd0fe428a849d6ec8081ae29b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:45.986341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73928a-cc2a-4061-b58c-91c3df2b9f63 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:45.989444 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73928a-cc2a-4061-b58c-91c3df2b9f63 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:45.989926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73928a-cc2a-4061-b58c-91c3df2b9f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:46.025315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] The token cache is being invalidate because project f2e3db37f06f44279429ce240c7ba01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:46.025629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:46.030007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:46.045313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 873/1756] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:45 2022] DELETE /identity/v3/projects/f2e3db37f06f44279429ce240c7ba01c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:22:46.046495 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:46.050316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:46.057151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5d73928a-cc2a-4061-b58c-91c3df2b9f63 None None] MFA Rules not processed for user `9c6321d3fb5d4265aaff699fae301ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:46.061490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5d73928a-cc2a-4061-b58c-91c3df2b9f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:46.175944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 884/1757] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:46.183269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006b0d-ed43-442b-952b-d914095c50f8 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:46.184262 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006b0d-ed43-442b-952b-d914095c50f8 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:46.184628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006b0d-ed43-442b-952b-d914095c50f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:46.212757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f4006b0d-ed43-442b-952b-d914095c50f8 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:46.214339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f4006b0d-ed43-442b-952b-d914095c50f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:46.324267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80be57-5b8e-4107-b8d0-35dd2ee9c23f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:46.336970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:46.337918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:46.338205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:46.338485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] PATH_INFO: `/v3/users/9d4c6139836c4a2ead59d8fd93ed8923` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:46.341828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4c6139836c4a2ead59d8fd93ed8923)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:46.344997 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:46.389893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 885/1758] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:46.391901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebdb7b-1d15-4529-ae04-e8d6427d7a87 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:46.392196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebdb7b-1d15-4529-ae04-e8d6427d7a87 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:46.392512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebdb7b-1d15-4529-ae04-e8d6427d7a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:46.432873 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-01ebdb7b-1d15-4529-ae04-e8d6427d7a87 None None] MFA Rules not processed for user `1d959b149003454c83105a7ed6ad7003`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:46.435023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-01ebdb7b-1d15-4529-ae04-e8d6427d7a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:46.502363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4c6139836c4a2ead59d8fd93ed8923'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:46.522176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:46.541652 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4c6139836c4a2ead59d8fd93ed8923'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:46.576632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4c6139836c4a2ead59d8fd93ed8923'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:46.576632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4c6139836c4a2ead59d8fd93ed8923'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:46.576632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4c6139836c4a2ead59d8fd93ed8923'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:46.589289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 886/1759] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:46.589289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da31866-2517-4270-982c-349cff6f3372 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:46.603809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da31866-2517-4270-982c-349cff6f3372 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:46.605765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da31866-2517-4270-982c-349cff6f3372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:46.630236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 874/1760] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:46 2022] DELETE /identity/v3/users/9d4c6139836c4a2ead59d8fd93ed8923 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:46.694464 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-9da31866-2517-4270-982c-349cff6f3372 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:46.705279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9da31866-2517-4270-982c-349cff6f3372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:46.812690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:46.928691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 887/1761] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:46.933888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:46.949843 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23e56-77ac-4df1-9238-2eca461c76b9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:46.962368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c70ec-3533-4804-a7d7-c9a8166c4eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:46.963036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c70ec-3533-4804-a7d7-c9a8166c4eae admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:46.963344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c70ec-3533-4804-a7d7-c9a8166c4eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:46.963738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c70ec-3533-4804-a7d7-c9a8166c4eae admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:46.965025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c70ec-3533-4804-a7d7-c9a8166c4eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:46.965630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c70ec-3533-4804-a7d7-c9a8166c4eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:46.968621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c70ec-3533-4804-a7d7-c9a8166c4eae admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:47.002006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da31866-2517-4270-982c-349cff6f3372 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:47.010972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 875/1762] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:47.017182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da31866-2517-4270-982c-349cff6f3372 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:47.032900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09b5c-15de-4e42-b512-5826b382dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:47.033584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09b5c-15de-4e42-b512-5826b382dfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:47.033854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09b5c-15de-4e42-b512-5826b382dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:47.034126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09b5c-15de-4e42-b512-5826b382dfd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:47.034802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a09b5c-15de-4e42-b512-5826b382dfd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:47.041447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a09b5c-15de-4e42-b512-5826b382dfd8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:47.182583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 888/1763] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:47 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:47.188384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c70ec-3533-4804-a7d7-c9a8166c4eae admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:47.202105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c70ec-3533-4804-a7d7-c9a8166c4eae admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:47.309211 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccfdc6-845a-42db-a2ad-664c6aad3678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:47.311012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccfdc6-845a-42db-a2ad-664c6aad3678 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:47.311433 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccfdc6-845a-42db-a2ad-664c6aad3678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:47.311795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccfdc6-845a-42db-a2ad-664c6aad3678 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:47.313509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccfdc6-845a-42db-a2ad-664c6aad3678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:47.317530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccfdc6-845a-42db-a2ad-664c6aad3678 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:47.382685 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 876/1764] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:47 2022] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:47.387449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09b5c-15de-4e42-b512-5826b382dfd8 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:47.399906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09b5c-15de-4e42-b512-5826b382dfd8 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:47.406227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836697c-9458-465a-8a91-33e4881e9ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:47.407220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836697c-9458-465a-8a91-33e4881e9ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:47.408022 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836697c-9458-465a-8a91-33e4881e9ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:47.408517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836697c-9458-465a-8a91-33e4881e9ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:47.411288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836697c-9458-465a-8a91-33e4881e9ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:47.415875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94f04e-1c29-4763-bd3f-fcb9a10ff56d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:47.416589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94f04e-1c29-4763-bd3f-fcb9a10ff56d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:47.417062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94f04e-1c29-4763-bd3f-fcb9a10ff56d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:47.420124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 877/1765] 10.222.0.39 () {54 vars in 912 bytes} [Sat Sep 3 01:22:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:22:47.420657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836697c-9458-465a-8a91-33e4881e9ffa admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:47.425340 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239957e4-bc4e-4f50-9cd9-77ece1ed9eab None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:47.425884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239957e4-bc4e-4f50-9cd9-77ece1ed9eab None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:47.426507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239957e4-bc4e-4f50-9cd9-77ece1ed9eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:47.453827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 889/1766] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:47.457588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836697c-9458-465a-8a91-33e4881e9ffa admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:47.472574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-239957e4-bc4e-4f50-9cd9-77ece1ed9eab None None] MFA Rules not processed for user `8bec5c8c626c40ef9906783916c49dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:47.475183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-239957e4-bc4e-4f50-9cd9-77ece1ed9eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:47.482750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836697c-9458-465a-8a91-33e4881e9ffa admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:47.496384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bb55f-d2f9-4746-8433-af8acdc5917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:47.497021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb55f-d2f9-4746-8433-af8acdc5917e admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:47.498826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb55f-d2f9-4746-8433-af8acdc5917e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:47.498826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb55f-d2f9-4746-8433-af8acdc5917e admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:47.499996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bb55f-d2f9-4746-8433-af8acdc5917e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:47.505039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bb55f-d2f9-4746-8433-af8acdc5917e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:47.531874 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 890/1767] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:47.536246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bb55f-d2f9-4746-8433-af8acdc5917e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:47.557957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bb55f-d2f9-4746-8433-af8acdc5917e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:47.572285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6f8ce-c993-44c7-8d35-845518e12e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:47.573083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6f8ce-c993-44c7-8d35-845518e12e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:47.573365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6f8ce-c993-44c7-8d35-845518e12e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:47.573707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6f8ce-c993-44c7-8d35-845518e12e0e admin admin] PATH_INFO: `/v3/projects/0325c089b3114744ad2b069cec6d98b9/users/a360316193c040efa358b950ddedf53a/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:47.628847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 878/1768] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:22:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:47.631121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6f8ce-c993-44c7-8d35-845518e12e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0325c089b3114744ad2b069cec6d98b9, user_id=a360316193c040efa358b950ddedf53a, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:47.635777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6f8ce-c993-44c7-8d35-845518e12e0e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:47.651072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239957e4-bc4e-4f50-9cd9-77ece1ed9eab None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:47.659776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-239957e4-bc4e-4f50-9cd9-77ece1ed9eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:47.669683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 891/1769] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:47 2022] PUT /identity/v3/projects/0325c089b3114744ad2b069cec6d98b9/users/a360316193c040efa358b950ddedf53a/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:47.682181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239957e4-bc4e-4f50-9cd9-77ece1ed9eab None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:47.683101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ba8f-b69c-411e-831d-f2fc4951a254 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:47.683596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ba8f-b69c-411e-831d-f2fc4951a254 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:47.683935 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ba8f-b69c-411e-831d-f2fc4951a254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:47.724001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-db82ba8f-b69c-411e-831d-f2fc4951a254 None None] MFA Rules not processed for user `a360316193c040efa358b950ddedf53a`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:47.730154 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-db82ba8f-b69c-411e-831d-f2fc4951a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:47.796015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ad53b-f41d-457e-9c5b-180fe1b5d38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:47.796673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad53b-f41d-457e-9c5b-180fe1b5d38c service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:47.796964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad53b-f41d-457e-9c5b-180fe1b5d38c service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:47.797241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad53b-f41d-457e-9c5b-180fe1b5d38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:47.818560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ad53b-f41d-457e-9c5b-180fe1b5d38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:47.820131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ad53b-f41d-457e-9c5b-180fe1b5d38c service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:47.824782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:47.832209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 879/1770] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:47.877781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 892/1771] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:22:47.882656 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ad53b-f41d-457e-9c5b-180fe1b5d38c service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:47.915505 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82ba8f-b69c-411e-831d-f2fc4951a254 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:47.916959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-db82ba8f-b69c-411e-831d-f2fc4951a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:48.004631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ad53b-f41d-457e-9c5b-180fe1b5d38c service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:48.017950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1977ad-31cc-4a3d-a8fc-0a8d00abdbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:48.018586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1977ad-31cc-4a3d-a8fc-0a8d00abdbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:48.018868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1977ad-31cc-4a3d-a8fc-0a8d00abdbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:48.019141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1977ad-31cc-4a3d-a8fc-0a8d00abdbe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:48.020026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1977ad-31cc-4a3d-a8fc-0a8d00abdbe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:48.022866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1977ad-31cc-4a3d-a8fc-0a8d00abdbe2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:48.023631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:48.062756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82ba8f-b69c-411e-831d-f2fc4951a254 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:48.070605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:48.071368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:48.071628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:48.071900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] PATH_INFO: `/v3/projects/080849298af641ddaa38e912b6d3dccf` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:48.073351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=080849298af641ddaa38e912b6d3dccf)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:48.076270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:48.105681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 880/1772] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:47 2022] POST /identity/v3/projects => generated 363 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:48.107129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626f64c-80fb-4b24-82d7-828a06e3ad79 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:48.109938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626f64c-80fb-4b24-82d7-828a06e3ad79 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:48.110229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626f64c-80fb-4b24-82d7-828a06e3ad79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:48.181758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080849298af641ddaa38e912b6d3dccf', 'request_id': 'req-419b3763-da34-4763-a559-c177834d7e97'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:48.214843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080849298af641ddaa38e912b6d3dccf', 'request_id': 'req-419b3763-da34-4763-a559-c177834d7e97'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:48.225195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080849298af641ddaa38e912b6d3dccf', 'request_id': 'req-419b3763-da34-4763-a559-c177834d7e97'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:48.243454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f626f64c-80fb-4b24-82d7-828a06e3ad79 None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:48.245115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f626f64c-80fb-4b24-82d7-828a06e3ad79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:48.263158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] The token cache is being invalidate because project 080849298af641ddaa38e912b6d3dccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:48.263680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:48.270282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:48.281120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 893/1773] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:47 2022] DELETE /identity/v3/projects/080849298af641ddaa38e912b6d3dccf => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:48.282965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:48.285071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:48.411297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b3763-da34-4763-a559-c177834d7e97 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:48.417375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f9cf9-b9e9-4dfa-b13f-c6c85b62fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:48.418627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f9cf9-b9e9-4dfa-b13f-c6c85b62fa86 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:48.418758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f9cf9-b9e9-4dfa-b13f-c6c85b62fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:48.419030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f9cf9-b9e9-4dfa-b13f-c6c85b62fa86 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:48.419644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f9cf9-b9e9-4dfa-b13f-c6c85b62fa86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:48.421574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f9cf9-b9e9-4dfa-b13f-c6c85b62fa86 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:48.464343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 894/1774] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:48 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:48.466382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987393-5073-4b21-b025-7b10bf71d0aa None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:48.466861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987393-5073-4b21-b025-7b10bf71d0aa None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:48.468117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987393-5073-4b21-b025-7b10bf71d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:48.472531 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 881/1775] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:48.485045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626f64c-80fb-4b24-82d7-828a06e3ad79 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:48.529302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626f64c-80fb-4b24-82d7-828a06e3ad79 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:48.535101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03082515-9951-496a-8138-1503d6544907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:48.535963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082515-9951-496a-8138-1503d6544907 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:48.536276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082515-9951-496a-8138-1503d6544907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:48.536616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082515-9951-496a-8138-1503d6544907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:48.537326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03082515-9951-496a-8138-1503d6544907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:48.539007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03082515-9951-496a-8138-1503d6544907 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:48.539427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-23987393-5073-4b21-b025-7b10bf71d0aa None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:48.540681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-23987393-5073-4b21-b025-7b10bf71d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:48.550029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 895/1776] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:48.554471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 882/1777] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:48.555834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23987393-5073-4b21-b025-7b10bf71d0aa None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:48.557732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bf312-9238-4f68-95e9-292fc66eee96 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:48.558535 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bf312-9238-4f68-95e9-292fc66eee96 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:48.558535 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bf312-9238-4f68-95e9-292fc66eee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:48.576868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23987393-5073-4b21-b025-7b10bf71d0aa None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:48.590975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db6372-7f97-47c1-82b6-0e1fa015bc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:48.593294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db6372-7f97-47c1-82b6-0e1fa015bc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:48.593294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db6372-7f97-47c1-82b6-0e1fa015bc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:48.593514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db6372-7f97-47c1-82b6-0e1fa015bc98 admin admin] PATH_INFO: `/v3/projects/1f15d69549f74f99980dc83740030cd5/users/b41dd0b85b2f40d0ae56fca47c183507/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:48.603984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ab0bf312-9238-4f68-95e9-292fc66eee96 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:48.605271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ab0bf312-9238-4f68-95e9-292fc66eee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:48.630085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db6372-7f97-47c1-82b6-0e1fa015bc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f15d69549f74f99980dc83740030cd5, user_id=b41dd0b85b2f40d0ae56fca47c183507, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:48.631399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 883/1778] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:48.633141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bf312-9238-4f68-95e9-292fc66eee96 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:48.637688 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db6372-7f97-47c1-82b6-0e1fa015bc98 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:48.659466 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bf312-9238-4f68-95e9-292fc66eee96 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:48.674014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55df8a-fd40-4fcc-9ee7-67324bfd5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:48.674814 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55df8a-fd40-4fcc-9ee7-67324bfd5689 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:48.675285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55df8a-fd40-4fcc-9ee7-67324bfd5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:48.675687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55df8a-fd40-4fcc-9ee7-67324bfd5689 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:48.676480 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55df8a-fd40-4fcc-9ee7-67324bfd5689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:22:48.677091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55df8a-fd40-4fcc-9ee7-67324bfd5689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:48.678838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55df8a-fd40-4fcc-9ee7-67324bfd5689 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:48.685014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 896/1779] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:48 2022] PUT /identity/v3/projects/1f15d69549f74f99980dc83740030cd5/users/b41dd0b85b2f40d0ae56fca47c183507/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:22:48.690427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db6372-7f97-47c1-82b6-0e1fa015bc98 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:48.720995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 884/1780] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:22:48.733552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55df8a-fd40-4fcc-9ee7-67324bfd5689 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:48.792631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55df8a-fd40-4fcc-9ee7-67324bfd5689 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:48.868013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:48.917246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:48.996044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db6372-7f97-47c1-82b6-0e1fa015bc98 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:48.998091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18ca8e-ccac-46f6-aeff-eb78be75df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:48.998938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18ca8e-ccac-46f6-aeff-eb78be75df55 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:48.999432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18ca8e-ccac-46f6-aeff-eb78be75df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:49.001506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18ca8e-ccac-46f6-aeff-eb78be75df55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:49.005439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18ca8e-ccac-46f6-aeff-eb78be75df55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:49.010198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18ca8e-ccac-46f6-aeff-eb78be75df55 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:49.015059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df1ba8-71cf-4b72-a84f-0b4d5f29b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:49.015779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df1ba8-71cf-4b72-a84f-0b4d5f29b27f admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:49.016064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df1ba8-71cf-4b72-a84f-0b4d5f29b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:49.016336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df1ba8-71cf-4b72-a84f-0b4d5f29b27f admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:49.017141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df1ba8-71cf-4b72-a84f-0b4d5f29b27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:49.019002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df1ba8-71cf-4b72-a84f-0b4d5f29b27f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:49.037209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 897/1781] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:49.038399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df1ba8-71cf-4b72-a84f-0b4d5f29b27f admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:49.040739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-92df1ba8-71cf-4b72-a84f-0b4d5f29b27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:49.100834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 885/1782] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:48 2022] POST /identity/v3/projects => generated 387 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:49.101753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18ca8e-ccac-46f6-aeff-eb78be75df55 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:49.360003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df1ba8-71cf-4b72-a84f-0b4d5f29b27f admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:49.385976 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18ca8e-ccac-46f6-aeff-eb78be75df55 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:49.393137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2594-ce9c-44d9-b3a3-6e5fd73db238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:49.394228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2594-ce9c-44d9-b3a3-6e5fd73db238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:49.394677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2594-ce9c-44d9-b3a3-6e5fd73db238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:49.395135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2594-ce9c-44d9-b3a3-6e5fd73db238 admin admin] PATH_INFO: `/v3/projects/1f15d69549f74f99980dc83740030cd5/users/b41dd0b85b2f40d0ae56fca47c183507/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:49.398471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a2594-ce9c-44d9-b3a3-6e5fd73db238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f15d69549f74f99980dc83740030cd5, user_id=b41dd0b85b2f40d0ae56fca47c183507, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:49.404591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a2594-ce9c-44d9-b3a3-6e5fd73db238 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:49.463566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 886/1783] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:49 2022] PUT /identity/v3/projects/1f15d69549f74f99980dc83740030cd5/users/b41dd0b85b2f40d0ae56fca47c183507/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:49.463566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2594-ce9c-44d9-b3a3-6e5fd73db238 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:49.601319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b78aac-ccd1-45ec-aa5c-f588c3cbdc55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:49.602318 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78aac-ccd1-45ec-aa5c-f588c3cbdc55 service swift] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:49.603084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78aac-ccd1-45ec-aa5c-f588c3cbdc55 service swift] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:49.603518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78aac-ccd1-45ec-aa5c-f588c3cbdc55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:49.704608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2594-ce9c-44d9-b3a3-6e5fd73db238 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:49.717255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28553-ceaa-48b3-936c-bf2ad84552f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:49.718933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28553-ceaa-48b3-936c-bf2ad84552f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:49.720603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28553-ceaa-48b3-936c-bf2ad84552f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:49.721035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28553-ceaa-48b3-936c-bf2ad84552f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:49.722150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28553-ceaa-48b3-936c-bf2ad84552f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:49.727977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28553-ceaa-48b3-936c-bf2ad84552f2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:49.787991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b78aac-ccd1-45ec-aa5c-f588c3cbdc55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:49.791314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b78aac-ccd1-45ec-aa5c-f588c3cbdc55 service swift] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:49.797754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:49.803187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 898/1784] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:22:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:22:49.826645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ab67c-8caf-4455-812c-a7bef6f4c3f9 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:49.827443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ab67c-8caf-4455-812c-a7bef6f4c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:49.827851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ab67c-8caf-4455-812c-a7bef6f4c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:49.831098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 887/1785] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:49 2022] POST /identity/v3/users => generated 294 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:49.835723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28553-ceaa-48b3-936c-bf2ad84552f2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:49.862730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28553-ceaa-48b3-936c-bf2ad84552f2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:49.873379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fee71a-148e-4991-8aa5-18fe7d6e2f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:49.873954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fee71a-148e-4991-8aa5-18fe7d6e2f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:49.874231 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fee71a-148e-4991-8aa5-18fe7d6e2f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:49.874502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fee71a-148e-4991-8aa5-18fe7d6e2f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:49.875652 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fee71a-148e-4991-8aa5-18fe7d6e2f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:49.880398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fee71a-148e-4991-8aa5-18fe7d6e2f4c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:49.918863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 888/1786] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:49.927212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fee71a-148e-4991-8aa5-18fe7d6e2f4c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:49.957570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fee71a-148e-4991-8aa5-18fe7d6e2f4c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:49.973453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86b566-4026-492f-8da0-7150ab712028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:49.976247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86b566-4026-492f-8da0-7150ab712028 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:49.976903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86b566-4026-492f-8da0-7150ab712028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:49.978000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86b566-4026-492f-8da0-7150ab712028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:49.980063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86b566-4026-492f-8da0-7150ab712028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:49.982294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86b566-4026-492f-8da0-7150ab712028 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:50.012657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 889/1787] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:50.015785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86b566-4026-492f-8da0-7150ab712028 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:50.043462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86b566-4026-492f-8da0-7150ab712028 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:50.043793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6b5ab67c-8caf-4455-812c-a7bef6f4c3f9 None None] MFA Rules not processed for user `b41dd0b85b2f40d0ae56fca47c183507`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:50.050295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e7e9-b797-4095-aef6-858882e53da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:50.051622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6b5ab67c-8caf-4455-812c-a7bef6f4c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:50.051995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e7e9-b797-4095-aef6-858882e53da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:50.054802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e7e9-b797-4095-aef6-858882e53da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:50.055329 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e7e9-b797-4095-aef6-858882e53da9 admin admin] PATH_INFO: `/v3/projects/d254c1b60f35446b8e8f4acbf4a3dc83/users/21b084009dba4d9ea3d931b1c180860c/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:50.070262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:50.083614 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618e7e9-b797-4095-aef6-858882e53da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d254c1b60f35446b8e8f4acbf4a3dc83, user_id=21b084009dba4d9ea3d931b1c180860c, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:50.091708 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618e7e9-b797-4095-aef6-858882e53da9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:50.126686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 890/1788] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:50 2022] PUT /identity/v3/projects/d254c1b60f35446b8e8f4acbf4a3dc83/users/21b084009dba4d9ea3d931b1c180860c/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:50.140087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf4f9-4eec-4d3d-9b37-d22c2d299f8c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:50.140584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf4f9-4eec-4d3d-9b37-d22c2d299f8c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:50.141053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf4f9-4eec-4d3d-9b37-d22c2d299f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:50.220567 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5baaf4f9-4eec-4d3d-9b37-d22c2d299f8c None None] MFA Rules not processed for user `21b084009dba4d9ea3d931b1c180860c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:50.225415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5baaf4f9-4eec-4d3d-9b37-d22c2d299f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:50.342555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 899/1789] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:50.342555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee264db-35f7-44d5-ad2e-4c3461851988 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:50.344829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee264db-35f7-44d5-ad2e-4c3461851988 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:50.345159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee264db-35f7-44d5-ad2e-4c3461851988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:50.466323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-eee264db-35f7-44d5-ad2e-4c3461851988 None None] MFA Rules not processed for user `8bec5c8c626c40ef9906783916c49dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:50.469644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-eee264db-35f7-44d5-ad2e-4c3461851988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:50.553242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 891/1790] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:50.553242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf4f9-4eec-4d3d-9b37-d22c2d299f8c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:50.560025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5baaf4f9-4eec-4d3d-9b37-d22c2d299f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:50.656865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 900/1791] 10.222.0.27 () {58 vars in 1015 bytes} [Sat Sep 3 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:50.657681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee264db-35f7-44d5-ad2e-4c3461851988 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:50.680496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf4f9-4eec-4d3d-9b37-d22c2d299f8c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:50.689327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd53e-34b8-49c8-a6d5-e0e9cfa0ee1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:50.690779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd53e-34b8-49c8-a6d5-e0e9cfa0ee1f service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:50.691165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd53e-34b8-49c8-a6d5-e0e9cfa0ee1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:50.694063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd53e-34b8-49c8-a6d5-e0e9cfa0ee1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:50.783906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fd53e-34b8-49c8-a6d5-e0e9cfa0ee1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:50.785865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fd53e-34b8-49c8-a6d5-e0e9cfa0ee1f service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:50.808107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee264db-35f7-44d5-ad2e-4c3461851988 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:50.811390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 892/1792] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:50.812770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd53e-34b8-49c8-a6d5-e0e9cfa0ee1f service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:50.814271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5b3fd53e-34b8-49c8-a6d5-e0e9cfa0ee1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:50.822690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e10a0c-9365-4cbb-b241-518e81209d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:50.825284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e10a0c-9365-4cbb-b241-518e81209d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:50.825904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e10a0c-9365-4cbb-b241-518e81209d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:50.826805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e10a0c-9365-4cbb-b241-518e81209d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:50.829759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e10a0c-9365-4cbb-b241-518e81209d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:50.830858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd53e-34b8-49c8-a6d5-e0e9cfa0ee1f service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:50.835529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678271ed-8025-4b9f-9c01-6a1c844839ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:50.836212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e10a0c-9365-4cbb-b241-518e81209d60 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:50.836364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678271ed-8025-4b9f-9c01-6a1c844839ce service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:50.836728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678271ed-8025-4b9f-9c01-6a1c844839ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:50.837132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678271ed-8025-4b9f-9c01-6a1c844839ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:50.839655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-678271ed-8025-4b9f-9c01-6a1c844839ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:50.873761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:50.930997 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 901/1793] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:22:50 2022] POST /identity/v3/projects => generated 383 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:50.932141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e10a0c-9365-4cbb-b241-518e81209d60 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:50.937708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-76e10a0c-9365-4cbb-b241-518e81209d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:50.990620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678271ed-8025-4b9f-9c01-6a1c844839ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:50.993965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:50.995601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678271ed-8025-4b9f-9c01-6a1c844839ce service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:51.013323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 893/1794] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:51.028616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678271ed-8025-4b9f-9c01-6a1c844839ce service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:51.037561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e10a0c-9365-4cbb-b241-518e81209d60 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:51.042040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472966f-33ae-42a0-8162-53ea4d7a7041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:51.042798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472966f-33ae-42a0-8162-53ea4d7a7041 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:51.043404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472966f-33ae-42a0-8162-53ea4d7a7041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:51.043693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472966f-33ae-42a0-8162-53ea4d7a7041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:51.052428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472966f-33ae-42a0-8162-53ea4d7a7041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:51.054049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472966f-33ae-42a0-8162-53ea4d7a7041 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:51.056847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678271ed-8025-4b9f-9c01-6a1c844839ce service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:51.064645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 902/1795] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:51.291623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec64e9d-65a8-4b44-9bfc-7ee6d498fde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:51.294474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec64e9d-65a8-4b44-9bfc-7ee6d498fde1 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:51.295229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec64e9d-65a8-4b44-9bfc-7ee6d498fde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:51.295534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec64e9d-65a8-4b44-9bfc-7ee6d498fde1 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:51.296652 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec64e9d-65a8-4b44-9bfc-7ee6d498fde1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:51.311410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec64e9d-65a8-4b44-9bfc-7ee6d498fde1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:51.377697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 894/1796] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:22:51 2022] POST /identity/v3/users => generated 298 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:22:51.382105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472966f-33ae-42a0-8162-53ea4d7a7041 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:51.407844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472966f-33ae-42a0-8162-53ea4d7a7041 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:51.427452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449db39-c64d-4c6c-80ca-5b228f704ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:51.429135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449db39-c64d-4c6c-80ca-5b228f704ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:51.429419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449db39-c64d-4c6c-80ca-5b228f704ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:51.431157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449db39-c64d-4c6c-80ca-5b228f704ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:51.431964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449db39-c64d-4c6c-80ca-5b228f704ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:51.436536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449db39-c64d-4c6c-80ca-5b228f704ee2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:51.465078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 903/1797] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:51.469839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec64e9d-65a8-4b44-9bfc-7ee6d498fde1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:51.485596 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec64e9d-65a8-4b44-9bfc-7ee6d498fde1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:51.500519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd87b6-010e-4dbd-bedf-569f616a62a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:51.501284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd87b6-010e-4dbd-bedf-569f616a62a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:51.502928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd87b6-010e-4dbd-bedf-569f616a62a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:51.503212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd87b6-010e-4dbd-bedf-569f616a62a7 admin admin] PATH_INFO: `/v3/projects/f3cd61daa8ca493f8e99647ef1ac85f4/users/fe8c0c0080b5438c9b60853302ccfcab/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:51.573487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd87b6-010e-4dbd-bedf-569f616a62a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3cd61daa8ca493f8e99647ef1ac85f4, user_id=fe8c0c0080b5438c9b60853302ccfcab, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:51.576537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd87b6-010e-4dbd-bedf-569f616a62a7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:51.651218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 895/1798] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:51 2022] PUT /identity/v3/projects/f3cd61daa8ca493f8e99647ef1ac85f4/users/fe8c0c0080b5438c9b60853302ccfcab/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:22:51.673504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449db39-c64d-4c6c-80ca-5b228f704ee2 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:51.726516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449db39-c64d-4c6c-80ca-5b228f704ee2 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:51.921123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133601b8-64d9-41ae-b550-4f14a81629ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:51.924217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133601b8-64d9-41ae-b550-4f14a81629ba admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:51.925263 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133601b8-64d9-41ae-b550-4f14a81629ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:51.926737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133601b8-64d9-41ae-b550-4f14a81629ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:51.929157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133601b8-64d9-41ae-b550-4f14a81629ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:51.939307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133601b8-64d9-41ae-b550-4f14a81629ba admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:51.978040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 904/1799] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:22:51.978700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd87b6-010e-4dbd-bedf-569f616a62a7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:51.998401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd87b6-010e-4dbd-bedf-569f616a62a7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:52.019072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8d06f-e23f-4f54-9cb0-29cd10200b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:52.022169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d06f-e23f-4f54-9cb0-29cd10200b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:52.024369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d06f-e23f-4f54-9cb0-29cd10200b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:52.027696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d06f-e23f-4f54-9cb0-29cd10200b44 admin admin] PATH_INFO: `/v3/projects/f3cd61daa8ca493f8e99647ef1ac85f4/users/fe8c0c0080b5438c9b60853302ccfcab/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:52.037028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8d06f-e23f-4f54-9cb0-29cd10200b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3cd61daa8ca493f8e99647ef1ac85f4, user_id=fe8c0c0080b5438c9b60853302ccfcab, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:52.040136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8d06f-e23f-4f54-9cb0-29cd10200b44 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:52.057980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133601b8-64d9-41ae-b550-4f14a81629ba admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:52.089987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 896/1800] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:22:51 2022] PUT /identity/v3/projects/f3cd61daa8ca493f8e99647ef1ac85f4/users/fe8c0c0080b5438c9b60853302ccfcab/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:22:52.102048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eafbe0-ffe4-439a-929d-a07625ab3200 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:52.102213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eafbe0-ffe4-439a-929d-a07625ab3200 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:52.103004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eafbe0-ffe4-439a-929d-a07625ab3200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:52.157947 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-86eafbe0-ffe4-439a-929d-a07625ab3200 None None] MFA Rules not processed for user `fe8c0c0080b5438c9b60853302ccfcab`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:52.159978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-86eafbe0-ffe4-439a-929d-a07625ab3200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:52.236604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133601b8-64d9-41ae-b550-4f14a81629ba admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:52.335200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d5ee3-2b41-4def-971b-d6a67baa33a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:52.338071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d5ee3-2b41-4def-971b-d6a67baa33a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:52.339211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d5ee3-2b41-4def-971b-d6a67baa33a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:52.340986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d5ee3-2b41-4def-971b-d6a67baa33a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:52.344330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b40d5ee3-2b41-4def-971b-d6a67baa33a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:52.381832 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:52.391224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:52.406159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 897/1801] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:52.507100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d5ee3-2b41-4def-971b-d6a67baa33a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:52.509241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d5ee3-2b41-4def-971b-d6a67baa33a9 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:52.535745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 905/1802] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:52.706616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eafbe0-ffe4-439a-929d-a07625ab3200 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:52.755576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eafbe0-ffe4-439a-929d-a07625ab3200 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:52.767065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedd776-ff27-42b5-a736-18ed6922fd7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:52.767588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedd776-ff27-42b5-a736-18ed6922fd7e service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:52.767884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedd776-ff27-42b5-a736-18ed6922fd7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:52.768147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedd776-ff27-42b5-a736-18ed6922fd7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:52.798733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedd776-ff27-42b5-a736-18ed6922fd7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:52.800404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedd776-ff27-42b5-a736-18ed6922fd7e service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:52.814142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 898/1803] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:53.049759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5bee5-8dfa-412b-8a43-344372d36619 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:53.051114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5bee5-8dfa-412b-8a43-344372d36619 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:53.051759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5bee5-8dfa-412b-8a43-344372d36619 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:53.054798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 906/1804] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:22:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:22:53.070098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8439-bb9e-4082-bf5f-49d0e803daaf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:53.070679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8439-bb9e-4082-bf5f-49d0e803daaf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:53.070845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8439-bb9e-4082-bf5f-49d0e803daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:53.109258 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f95e8439-bb9e-4082-bf5f-49d0e803daaf None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:53.110495 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f95e8439-bb9e-4082-bf5f-49d0e803daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:53.380817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 899/1805] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:22:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:53.406230 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5bee5-8dfa-412b-8a43-344372d36619 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:53.410385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-dcd5bee5-8dfa-412b-8a43-344372d36619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:53.452918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5bee5-8dfa-412b-8a43-344372d36619 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:53.461705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc01a31-bf7e-43c0-a155-2229fcc83aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:53.462764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc01a31-bf7e-43c0-a155-2229fcc83aed service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:53.463392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc01a31-bf7e-43c0-a155-2229fcc83aed service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:53.463894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc01a31-bf7e-43c0-a155-2229fcc83aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:53.528370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc01a31-bf7e-43c0-a155-2229fcc83aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:53.530784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc01a31-bf7e-43c0-a155-2229fcc83aed service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:53.555955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 907/1806] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:54.500592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e8439-bb9e-4082-bf5f-49d0e803daaf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:54.687868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e8439-bb9e-4082-bf5f-49d0e803daaf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:54.693771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:54.694750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:54.695201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:54.695666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] PATH_INFO: `/v3/users/21b084009dba4d9ea3d931b1c180860c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:54.707292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b084009dba4d9ea3d931b1c180860c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:54.709768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:54.864774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b084009dba4d9ea3d931b1c180860c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:54.914593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b084009dba4d9ea3d931b1c180860c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:54.934726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b084009dba4d9ea3d931b1c180860c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:54.935800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b084009dba4d9ea3d931b1c180860c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:54.936657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b084009dba4d9ea3d931b1c180860c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:54.960773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:54.983566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 900/1807] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:54 2022] DELETE /identity/v3/users/21b084009dba4d9ea3d931b1c180860c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:54.988476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5d33-b53e-49bd-8e2d-3f028d034f9e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:54.995768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5d33-b53e-49bd-8e2d-3f028d034f9e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:54.996478 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5d33-b53e-49bd-8e2d-3f028d034f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:55.052730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-aa4f5d33-b53e-49bd-8e2d-3f028d034f9e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:55.056319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-aa4f5d33-b53e-49bd-8e2d-3f028d034f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:55.281802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 908/1808] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:55.368356 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:55.370313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:55.574695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30650c-a04e-437b-a379-bce1cf49e7ea admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:55.592611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b90563-f173-4dca-b2f3-6eba53faffa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:55.593287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b90563-f173-4dca-b2f3-6eba53faffa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:55.593564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b90563-f173-4dca-b2f3-6eba53faffa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:55.593837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b90563-f173-4dca-b2f3-6eba53faffa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:55.627949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b90563-f173-4dca-b2f3-6eba53faffa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:55.629485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b90563-f173-4dca-b2f3-6eba53faffa6 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:55.695314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 901/1809] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:56.711400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f5d33-b53e-49bd-8e2d-3f028d034f9e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:56.716903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-aa4f5d33-b53e-49bd-8e2d-3f028d034f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:56.737068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f5d33-b53e-49bd-8e2d-3f028d034f9e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:56.744993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:56.745753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:56.746320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:56.746812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] PATH_INFO: `/v3/users/a360316193c040efa358b950ddedf53a` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:56.749019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a360316193c040efa358b950ddedf53a)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:56.752758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:56.881996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a360316193c040efa358b950ddedf53a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:56.922230 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a360316193c040efa358b950ddedf53a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:56.941646 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a360316193c040efa358b950ddedf53a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:56.943146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a360316193c040efa358b950ddedf53a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:56.943681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a360316193c040efa358b950ddedf53a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:56.979038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 909/1810] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:56 2022] DELETE /identity/v3/users/a360316193c040efa358b950ddedf53a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:56.984946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941ba7f-78e2-44b1-ad9c-2613bf8fa451 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:56.985519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941ba7f-78e2-44b1-ad9c-2613bf8fa451 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:56.985737 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941ba7f-78e2-44b1-ad9c-2613bf8fa451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:57.031123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4941ba7f-78e2-44b1-ad9c-2613bf8fa451 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:57.033687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4941ba7f-78e2-44b1-ad9c-2613bf8fa451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:57.233264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 902/1811] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:57.465941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:57.467737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:57.483189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941ba7f-78e2-44b1-ad9c-2613bf8fa451 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:57.485540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4941ba7f-78e2-44b1-ad9c-2613bf8fa451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:57.500523 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daaf2f-bbbb-479e-b0b4-0ce842911f13 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:57.506927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:57.507512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:57.507796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:57.508058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] PATH_INFO: `/v3/users/08d90968210a4d7c98dad8a12f4b0717` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:57.509578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d90968210a4d7c98dad8a12f4b0717)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:57.512280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:57.533036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:57.642100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d90968210a4d7c98dad8a12f4b0717'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:57.691201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d90968210a4d7c98dad8a12f4b0717'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:57.711503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941ba7f-78e2-44b1-ad9c-2613bf8fa451 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:57.712685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d90968210a4d7c98dad8a12f4b0717'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:57.714444 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d90968210a4d7c98dad8a12f4b0717'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:57.715322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d90968210a4d7c98dad8a12f4b0717'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:57.722097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04f492-eb41-4a13-9c27-62ffe9b02851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:57.722939 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04f492-eb41-4a13-9c27-62ffe9b02851 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:57.723237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04f492-eb41-4a13-9c27-62ffe9b02851 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:57.728225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04f492-eb41-4a13-9c27-62ffe9b02851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:57.733946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aa04f492-eb41-4a13-9c27-62ffe9b02851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:57.755055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 910/1812] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:57 2022] DELETE /identity/v3/users/08d90968210a4d7c98dad8a12f4b0717 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:57.757087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:57.761895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:57.776657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04f492-eb41-4a13-9c27-62ffe9b02851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:57.779793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04f492-eb41-4a13-9c27-62ffe9b02851 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:57.819114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 903/1813] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:57.829150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5de09-e42a-437f-9682-bf74139efd91 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:57.829521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5de09-e42a-437f-9682-bf74139efd91 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:57.830836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5de09-e42a-437f-9682-bf74139efd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:57.909402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-98d5de09-e42a-437f-9682-bf74139efd91 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:57.920915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-98d5de09-e42a-437f-9682-bf74139efd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:58.062665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:58.072984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712501dd-1812-482b-929d-d7542e21bede admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:58.086459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:58.090615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:58.091573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:58.094058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] PATH_INFO: `/v3/projects/d254c1b60f35446b8e8f4acbf4a3dc83` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:58.096314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d254c1b60f35446b8e8f4acbf4a3dc83)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:58.100850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:58.111895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 904/1814] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:58.196164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd254c1b60f35446b8e8f4acbf4a3dc83', 'request_id': 'req-6c6e1324-0404-4e51-a2be-7516f5e6ce24'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:58.201935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5de09-e42a-437f-9682-bf74139efd91 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:58.203496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-98d5de09-e42a-437f-9682-bf74139efd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:58.212368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd254c1b60f35446b8e8f4acbf4a3dc83', 'request_id': 'req-6c6e1324-0404-4e51-a2be-7516f5e6ce24'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:58.223642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd254c1b60f35446b8e8f4acbf4a3dc83', 'request_id': 'req-6c6e1324-0404-4e51-a2be-7516f5e6ce24'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:58.252718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] The token cache is being invalidate because project d254c1b60f35446b8e8f4acbf4a3dc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:22:58.253013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:58.253862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:58.257822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 911/1815] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:22:57 2022] DELETE /identity/v3/projects/d254c1b60f35446b8e8f4acbf4a3dc83 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:58.262852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:58.279909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:58.345734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:58.360429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5de09-e42a-437f-9682-bf74139efd91 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:58.416779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e1324-0404-4e51-a2be-7516f5e6ce24 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:58.425418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:58.426549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:58.426999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:58.428525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] PATH_INFO: `/v3/users/fe8c0c0080b5438c9b60853302ccfcab` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:58.431123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8c0c0080b5438c9b60853302ccfcab)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:58.435513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:58.499135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4db167-c502-4608-90eb-f44fc0612704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:58.500331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4db167-c502-4608-90eb-f44fc0612704 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:58.504290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4db167-c502-4608-90eb-f44fc0612704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:58.505300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4db167-c502-4608-90eb-f44fc0612704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:58.510644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3b4db167-c502-4608-90eb-f44fc0612704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:58.526510 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8c0c0080b5438c9b60853302ccfcab'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:58.546206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4db167-c502-4608-90eb-f44fc0612704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:58.549055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8c0c0080b5438c9b60853302ccfcab'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:58.551470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4db167-c502-4608-90eb-f44fc0612704 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:58.562590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8c0c0080b5438c9b60853302ccfcab'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:58.564643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8c0c0080b5438c9b60853302ccfcab'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:58.565534 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8c0c0080b5438c9b60853302ccfcab'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:58.594942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 912/1816] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:58 2022] DELETE /identity/v3/users/fe8c0c0080b5438c9b60853302ccfcab => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:22:58.614974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 905/1817] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:22:58.772054 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:58.774531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:58.777644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ca6ee-72d3-4415-b88d-965d4f56c729 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:58.778460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ca6ee-72d3-4415-b88d-965d4f56c729 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:58.778934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ca6ee-72d3-4415-b88d-965d4f56c729 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:58.780737 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 906/1818] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:22:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:22:58.899850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68b4a0-ceee-4ee3-97de-49702c9391a9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:58.912305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76725987-08b6-4ffb-9f48-d52320d3911f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:58.913008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76725987-08b6-4ffb-9f48-d52320d3911f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:58.913113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:58.913622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76725987-08b6-4ffb-9f48-d52320d3911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:58.913931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:58.914400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:58.914741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] PATH_INFO: `/v3/users/3a69722a22d24e69851791cc4c5e7da4` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:58.916291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a69722a22d24e69851791cc4c5e7da4)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:58.919196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:58.948846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-76725987-08b6-4ffb-9f48-d52320d3911f None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:58.955538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-76725987-08b6-4ffb-9f48-d52320d3911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:59.000110 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:59.008408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a69722a22d24e69851791cc4c5e7da4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:59.055345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a69722a22d24e69851791cc4c5e7da4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:59.077978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a69722a22d24e69851791cc4c5e7da4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:59.079628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a69722a22d24e69851791cc4c5e7da4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:59.081144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a69722a22d24e69851791cc4c5e7da4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:22:59.089719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 907/1819] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:59.109467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 913/1820] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:22:58 2022] DELETE /identity/v3/users/3a69722a22d24e69851791cc4c5e7da4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:22:59.114024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6aeb-4c9f-4abc-987a-021f643f9fc0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:59.114311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6aeb-4c9f-4abc-987a-021f643f9fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:59.114580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6aeb-4c9f-4abc-987a-021f643f9fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:59.174667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9b2e6aeb-4c9f-4abc-987a-021f643f9fc0 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:22:59.177361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9b2e6aeb-4c9f-4abc-987a-021f643f9fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:59.255062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:22:59.375285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 908/1821] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:22:59.438649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:59.440216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:22:59.592296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88567f1c-9cf1-4add-8e3d-8fbc5b305185 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:22:59.601210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feb7b3-7afc-48e7-ba76-0c93580ef72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:22:59.602031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feb7b3-7afc-48e7-ba76-0c93580ef72a service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:22:59.602147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feb7b3-7afc-48e7-ba76-0c93580ef72a service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:22:59.602765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feb7b3-7afc-48e7-ba76-0c93580ef72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:22:59.620201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4feb7b3-7afc-48e7-ba76-0c93580ef72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:22:59.621997 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4feb7b3-7afc-48e7-ba76-0c93580ef72a service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:22:59.650075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 914/1822] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:22:59.873870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e6aeb-4c9f-4abc-987a-021f643f9fc0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:22:59.876051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9b2e6aeb-4c9f-4abc-987a-021f643f9fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:00.056488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e6aeb-4c9f-4abc-987a-021f643f9fc0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:00.063763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ad853-c4b6-4edf-8b0d-9d98dcdd0ea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:00.066188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ad853-c4b6-4edf-8b0d-9d98dcdd0ea1 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:00.068996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ad853-c4b6-4edf-8b0d-9d98dcdd0ea1 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:00.069757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ad853-c4b6-4edf-8b0d-9d98dcdd0ea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:00.083305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e73ad853-c4b6-4edf-8b0d-9d98dcdd0ea1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:00.103072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ad853-c4b6-4edf-8b0d-9d98dcdd0ea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:00.108337 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ad853-c4b6-4edf-8b0d-9d98dcdd0ea1 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:00.127962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 909/1823] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:22:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:00.609073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feb7b3-7afc-48e7-ba76-0c93580ef72a service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:00.612293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f4feb7b3-7afc-48e7-ba76-0c93580ef72a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:00.640204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feb7b3-7afc-48e7-ba76-0c93580ef72a service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:00.656240 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:00.658058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:00.658673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:00.659149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] PATH_INFO: `/v3/projects/0325c089b3114744ad2b069cec6d98b9` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:00.661123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0325c089b3114744ad2b069cec6d98b9)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:00.663404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:00.707005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ad853-c4b6-4edf-8b0d-9d98dcdd0ea1 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:00.709644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e73ad853-c4b6-4edf-8b0d-9d98dcdd0ea1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:00.759984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ad853-c4b6-4edf-8b0d-9d98dcdd0ea1 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:00.767139 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0325c089b3114744ad2b069cec6d98b9', 'request_id': 'req-d7abbe2b-7cd1-4eae-baf8-051771f00b13'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:00.779756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0325c089b3114744ad2b069cec6d98b9', 'request_id': 'req-d7abbe2b-7cd1-4eae-baf8-051771f00b13'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:00.795743 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0325c089b3114744ad2b069cec6d98b9', 'request_id': 'req-d7abbe2b-7cd1-4eae-baf8-051771f00b13'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:00.841171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] The token cache is being invalidate because project 0325c089b3114744ad2b069cec6d98b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:00.841936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:00.844330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:00.859584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 915/1824] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:00 2022] DELETE /identity/v3/projects/0325c089b3114744ad2b069cec6d98b9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:00.864984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:00.868123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:00.954931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:00.955719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:00.956082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:00.956425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] PATH_INFO: `/v3/projects/f3cd61daa8ca493f8e99647ef1ac85f4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:00.957659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3cd61daa8ca493f8e99647ef1ac85f4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:00.960030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:01.015283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:01.051823 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3cd61daa8ca493f8e99647ef1ac85f4', 'request_id': 'req-fa493796-5c53-4ee3-81ac-84cb2d327fac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.058622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abbe2b-7cd1-4eae-baf8-051771f00b13 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:01.062528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3cd61daa8ca493f8e99647ef1ac85f4', 'request_id': 'req-fa493796-5c53-4ee3-81ac-84cb2d327fac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.074724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3cd61daa8ca493f8e99647ef1ac85f4', 'request_id': 'req-fa493796-5c53-4ee3-81ac-84cb2d327fac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.076276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:01.093476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] The token cache is being invalidate because project f3cd61daa8ca493f8e99647ef1ac85f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:01.094071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.094955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.096674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 910/1825] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:00 2022] DELETE /identity/v3/projects/f3cd61daa8ca493f8e99647ef1ac85f4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:01.098357 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:01.101821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:01.160714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:01.161755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:01.162043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:01.162318 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] PATH_INFO: `/v3/users/b41dd0b85b2f40d0ae56fca47c183507` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:01.163828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41dd0b85b2f40d0ae56fca47c183507)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:01.165781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:01.200177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa493796-5c53-4ee3-81ac-84cb2d327fac admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:01.205746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:01.206397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:01.206767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:01.207183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] PATH_INFO: `/v3/projects/519b2a33ba294c38ad0919aea3787dfa` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:01.208741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=519b2a33ba294c38ad0919aea3787dfa)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:01.212218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:01.229979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41dd0b85b2f40d0ae56fca47c183507'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.244540 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41dd0b85b2f40d0ae56fca47c183507'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.253345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41dd0b85b2f40d0ae56fca47c183507'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.254230 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41dd0b85b2f40d0ae56fca47c183507'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.255003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41dd0b85b2f40d0ae56fca47c183507'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.285355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519b2a33ba294c38ad0919aea3787dfa', 'request_id': 'req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.285570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 916/1826] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:00 2022] DELETE /identity/v3/users/b41dd0b85b2f40d0ae56fca47c183507 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:01.286275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:01.290091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:01.298102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519b2a33ba294c38ad0919aea3787dfa', 'request_id': 'req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.308226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519b2a33ba294c38ad0919aea3787dfa', 'request_id': 'req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.321206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] The token cache is being invalidate because project 519b2a33ba294c38ad0919aea3787dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:01.321665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.322567 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-11cbe39a-dc8a-42dd-830e-63cfb7ac0546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.326023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 911/1827] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:01 2022] DELETE /identity/v3/projects/519b2a33ba294c38ad0919aea3787dfa => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:01.334346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aa57e-c20d-4799-89b7-3575f9b22d73 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:01.334635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aa57e-c20d-4799-89b7-3575f9b22d73 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:01.334950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aa57e-c20d-4799-89b7-3575f9b22d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:01.365954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6e3aa57e-c20d-4799-89b7-3575f9b22d73 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:01.367812 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6e3aa57e-c20d-4799-89b7-3575f9b22d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:01.392096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd009e3-5de2-44a3-9e36-b6aab5082101 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:01.398537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:01.399200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:01.399537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:01.400247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] PATH_INFO: `/v3/projects/8891b5db8360468dbd2418b42dc8cc5d` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:01.400927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8891b5db8360468dbd2418b42dc8cc5d)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:01.415513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:01.433714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:01.482530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 912/1828] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:01.484302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aa57e-c20d-4799-89b7-3575f9b22d73 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:01.488670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6e3aa57e-c20d-4799-89b7-3575f9b22d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:01.502385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aa57e-c20d-4799-89b7-3575f9b22d73 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:01.515231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8891b5db8360468dbd2418b42dc8cc5d', 'request_id': 'req-7a3cac14-eeae-4216-9d70-bd83029b91dd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.521837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:01.531869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8891b5db8360468dbd2418b42dc8cc5d', 'request_id': 'req-7a3cac14-eeae-4216-9d70-bd83029b91dd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.539640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8891b5db8360468dbd2418b42dc8cc5d', 'request_id': 'req-7a3cac14-eeae-4216-9d70-bd83029b91dd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.551952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] The token cache is being invalidate because project 8891b5db8360468dbd2418b42dc8cc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:01.552352 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.553218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7a3cac14-eeae-4216-9d70-bd83029b91dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.555739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 917/1829] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:01 2022] DELETE /identity/v3/projects/8891b5db8360468dbd2418b42dc8cc5d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:01.556885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6ed65-1cf5-4b24-8087-13566ce927da None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:01.557232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6ed65-1cf5-4b24-8087-13566ce927da None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:01.557547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6ed65-1cf5-4b24-8087-13566ce927da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:01.581947 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:01.582365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-efa6ed65-1cf5-4b24-8087-13566ce927da None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:01.583108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:01.583523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:01.583902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] PATH_INFO: `/v3/users/9738d7de22d34ff8a5f699eb3971f81e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:01.584967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-efa6ed65-1cf5-4b24-8087-13566ce927da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:01.585477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9738d7de22d34ff8a5f699eb3971f81e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:01.587837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:01.597063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 918/1830] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:01.599066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6ed65-1cf5-4b24-8087-13566ce927da None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:01.600744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-efa6ed65-1cf5-4b24-8087-13566ce927da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:01.617172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6ed65-1cf5-4b24-8087-13566ce927da None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:01.628431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:01.629133 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:01.629757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:01.629757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] PATH_INFO: `/v3/users/36a814d6c053402885ef85fc374b0a19` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:01.630983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a814d6c053402885ef85fc374b0a19)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:01.632999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:01.660672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9738d7de22d34ff8a5f699eb3971f81e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.677408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9738d7de22d34ff8a5f699eb3971f81e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.685384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9738d7de22d34ff8a5f699eb3971f81e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.686305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9738d7de22d34ff8a5f699eb3971f81e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.686922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9738d7de22d34ff8a5f699eb3971f81e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.694509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a814d6c053402885ef85fc374b0a19'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.704880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 913/1831] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:01 2022] DELETE /identity/v3/users/9738d7de22d34ff8a5f699eb3971f81e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:01.706176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:01.707640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:01.715796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a814d6c053402885ef85fc374b0a19'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.725185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a814d6c053402885ef85fc374b0a19'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.726054 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a814d6c053402885ef85fc374b0a19'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.726751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a814d6c053402885ef85fc374b0a19'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:01.752708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 919/1832] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:01 2022] DELETE /identity/v3/users/36a814d6c053402885ef85fc374b0a19 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:01.791008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ee288-74f7-4f4d-9e1f-bf81d26d94bd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:01.847245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:01.851527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:01.854431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:01.872067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee16f1-8ad9-4b3c-b47d-1bf7d2b72acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:01.872710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee16f1-8ad9-4b3c-b47d-1bf7d2b72acf admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:01.872988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee16f1-8ad9-4b3c-b47d-1bf7d2b72acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:01.873937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee16f1-8ad9-4b3c-b47d-1bf7d2b72acf admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:01.875471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee16f1-8ad9-4b3c-b47d-1bf7d2b72acf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:01.875757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee16f1-8ad9-4b3c-b47d-1bf7d2b72acf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:01.878494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee16f1-8ad9-4b3c-b47d-1bf7d2b72acf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:01.907424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 914/1833] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:01.912124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee16f1-8ad9-4b3c-b47d-1bf7d2b72acf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:01.914514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ecee16f1-8ad9-4b3c-b47d-1bf7d2b72acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:01.930050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee16f1-8ad9-4b3c-b47d-1bf7d2b72acf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:01.936121 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620f44a-03e0-4909-8254-23d4727ed731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:01.936856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620f44a-03e0-4909-8254-23d4727ed731 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:01.937199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620f44a-03e0-4909-8254-23d4727ed731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:01.937532 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620f44a-03e0-4909-8254-23d4727ed731 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:01.938291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620f44a-03e0-4909-8254-23d4727ed731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:01.940404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620f44a-03e0-4909-8254-23d4727ed731 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:01.970087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75c634-2708-47f6-b2e0-39998f339afd admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:01.975159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 915/1834] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:01 2022] POST /identity/v3/projects => generated 359 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:01.979414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620f44a-03e0-4909-8254-23d4727ed731 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:01.982084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:01.983161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:01.983825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:01.985040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] PATH_INFO: `/v3/projects/1f15d69549f74f99980dc83740030cd5` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:01.990065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f15d69549f74f99980dc83740030cd5)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:01.993769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:02.007055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:02.070794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620f44a-03e0-4909-8254-23d4727ed731 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:02.072770 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f15d69549f74f99980dc83740030cd5', 'request_id': 'req-f09c7794-f789-4651-bfe4-a5c38dc2705b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.084962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f15d69549f74f99980dc83740030cd5', 'request_id': 'req-f09c7794-f789-4651-bfe4-a5c38dc2705b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.093718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f15d69549f74f99980dc83740030cd5', 'request_id': 'req-f09c7794-f789-4651-bfe4-a5c38dc2705b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.119583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] The token cache is being invalidate because project 1f15d69549f74f99980dc83740030cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:02.119910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.120687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f09c7794-f789-4651-bfe4-a5c38dc2705b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.123337 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 920/1835] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:01 2022] DELETE /identity/v3/projects/1f15d69549f74f99980dc83740030cd5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:02.127682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c410a-ee9a-4626-a9e8-2a3bd0b199ec None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.128021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c410a-ee9a-4626-a9e8-2a3bd0b199ec None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.128777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c410a-ee9a-4626-a9e8-2a3bd0b199ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.153725 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ff2c410a-ee9a-4626-a9e8-2a3bd0b199ec None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:02.155048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ff2c410a-ee9a-4626-a9e8-2a3bd0b199ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:02.207738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95497a-65bc-4c08-b4de-a230c301beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:02.208521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95497a-65bc-4c08-b4de-a230c301beba admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.209054 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95497a-65bc-4c08-b4de-a230c301beba admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.209550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95497a-65bc-4c08-b4de-a230c301beba admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.210562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95497a-65bc-4c08-b4de-a230c301beba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:02.212840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95497a-65bc-4c08-b4de-a230c301beba admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:02.257720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 921/1836] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:02.258593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 916/1837] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:01 2022] POST /identity/v3/users => generated 280 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:02.259187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c410a-ee9a-4626-a9e8-2a3bd0b199ec None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:02.260563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ff2c410a-ee9a-4626-a9e8-2a3bd0b199ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:02.267916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed43f9f-afa2-41e8-861f-ffd4e2cb0703 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.268728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed43f9f-afa2-41e8-861f-ffd4e2cb0703 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.269211 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed43f9f-afa2-41e8-861f-ffd4e2cb0703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.276111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c410a-ee9a-4626-a9e8-2a3bd0b199ec None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:02.286378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:02.288120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.288654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.289010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] PATH_INFO: `/v3/projects/ba17e169e69a401bb01c40ebdc4cac36` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.290334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba17e169e69a401bb01c40ebdc4cac36)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:02.293190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:02.299536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3ed43f9f-afa2-41e8-861f-ffd4e2cb0703 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:02.300919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3ed43f9f-afa2-41e8-861f-ffd4e2cb0703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:02.319393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 917/1838] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:02.320410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed43f9f-afa2-41e8-861f-ffd4e2cb0703 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:02.321853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3ed43f9f-afa2-41e8-861f-ffd4e2cb0703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:02.336864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed43f9f-afa2-41e8-861f-ffd4e2cb0703 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:02.344361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4384d-cab4-4e60-a2ce-8ea9202753e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:02.345208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4384d-cab4-4e60-a2ce-8ea9202753e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.345628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4384d-cab4-4e60-a2ce-8ea9202753e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.346047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4384d-cab4-4e60-a2ce-8ea9202753e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.347224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4384d-cab4-4e60-a2ce-8ea9202753e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:02.353948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4384d-cab4-4e60-a2ce-8ea9202753e6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:02.374936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 918/1839] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:02.375289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba17e169e69a401bb01c40ebdc4cac36', 'request_id': 'req-171c034e-4f2c-4d0d-a835-c9b1830eb851'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.375393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4384d-cab4-4e60-a2ce-8ea9202753e6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:02.390329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba17e169e69a401bb01c40ebdc4cac36', 'request_id': 'req-171c034e-4f2c-4d0d-a835-c9b1830eb851'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.394196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4384d-cab4-4e60-a2ce-8ea9202753e6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:02.405484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba17e169e69a401bb01c40ebdc4cac36', 'request_id': 'req-171c034e-4f2c-4d0d-a835-c9b1830eb851'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.417380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] The token cache is being invalidate because project ba17e169e69a401bb01c40ebdc4cac36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:02.418088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.419096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.421057 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 922/1840] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:02 2022] DELETE /identity/v3/projects/ba17e169e69a401bb01c40ebdc4cac36 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:02.421965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:02.423284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:02.441673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:02.453988 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:02.472806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6374180-dc7c-43d8-aeae-0ed1821ea7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:02.473462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6374180-dc7c-43d8-aeae-0ed1821ea7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.473745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6374180-dc7c-43d8-aeae-0ed1821ea7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.474497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6374180-dc7c-43d8-aeae-0ed1821ea7ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.474974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6374180-dc7c-43d8-aeae-0ed1821ea7ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:02.475297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6374180-dc7c-43d8-aeae-0ed1821ea7ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:02.477064 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6374180-dc7c-43d8-aeae-0ed1821ea7ac admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:02.501563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c034e-4f2c-4d0d-a835-c9b1830eb851 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:02.508881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:02.509666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.509946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.510223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] PATH_INFO: `/v3/projects/973a5f84182d4537b595124d9d882577` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.511446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973a5f84182d4537b595124d9d882577)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:02.513543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:02.517908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 919/1841] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:02.519505 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6374180-dc7c-43d8-aeae-0ed1821ea7ac admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:02.524860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b6374180-dc7c-43d8-aeae-0ed1821ea7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:02.560624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6374180-dc7c-43d8-aeae-0ed1821ea7ac admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:02.569457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb8ae9-ec51-4737-a334-9924df1e5d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:02.570795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8ae9-ec51-4737-a334-9924df1e5d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.571694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8ae9-ec51-4737-a334-9924df1e5d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.572103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8ae9-ec51-4737-a334-9924df1e5d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.573320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb8ae9-ec51-4737-a334-9924df1e5d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:02.575825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb8ae9-ec51-4737-a334-9924df1e5d6a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:02.580246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973a5f84182d4537b595124d9d882577', 'request_id': 'req-9d733471-0206-4e62-bc46-6c846f597a38'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.600089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973a5f84182d4537b595124d9d882577', 'request_id': 'req-9d733471-0206-4e62-bc46-6c846f597a38'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.600288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 920/1842] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:02.601761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40365d-ae62-4989-b14c-8de9e7420ac7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.603147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40365d-ae62-4989-b14c-8de9e7420ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.603788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40365d-ae62-4989-b14c-8de9e7420ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.622081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973a5f84182d4537b595124d9d882577', 'request_id': 'req-9d733471-0206-4e62-bc46-6c846f597a38'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.633762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-eb40365d-ae62-4989-b14c-8de9e7420ac7 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:02.643446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eb40365d-ae62-4989-b14c-8de9e7420ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:02.648145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] The token cache is being invalidate because project 973a5f84182d4537b595124d9d882577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:02.648450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.649257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:02.654682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 923/1843] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:02 2022] DELETE /identity/v3/projects/973a5f84182d4537b595124d9d882577 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:02.655770 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:02.657471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:02.736163 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d733471-0206-4e62-bc46-6c846f597a38 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:02.742489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813451-f360-468d-9783-50f30381d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:02.743116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813451-f360-468d-9783-50f30381d455 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.743444 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813451-f360-468d-9783-50f30381d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.743719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813451-f360-468d-9783-50f30381d455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.745161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813451-f360-468d-9783-50f30381d455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:02.749621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813451-f360-468d-9783-50f30381d455 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:02.784928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 921/1844] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:02.785945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40365d-ae62-4989-b14c-8de9e7420ac7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:02.787642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eb40365d-ae62-4989-b14c-8de9e7420ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:02.796001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 924/1845] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:02 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:02.797177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325fac9-97c0-4621-8033-601cf5cb7b30 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.797447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325fac9-97c0-4621-8033-601cf5cb7b30 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.797723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325fac9-97c0-4621-8033-601cf5cb7b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.806830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40365d-ae62-4989-b14c-8de9e7420ac7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:02.818972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-9325fac9-97c0-4621-8033-601cf5cb7b30 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:02.820376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9325fac9-97c0-4621-8033-601cf5cb7b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:02.889033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:02.896230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014f872-179d-4871-b808-0348a3d2c45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:02.897018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014f872-179d-4871-b808-0348a3d2c45d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.897305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014f872-179d-4871-b808-0348a3d2c45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.897577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014f872-179d-4871-b808-0348a3d2c45d admin admin] PATH_INFO: `/v3/projects/58b38020e36d4e76b7797879f6f24309/users/f63f486b29ef46909332bd969c51e48b/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.914921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014f872-179d-4871-b808-0348a3d2c45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b38020e36d4e76b7797879f6f24309, user_id=f63f486b29ef46909332bd969c51e48b, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:02.917808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014f872-179d-4871-b808-0348a3d2c45d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:02.930453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 925/1846] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:02.931954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376821-5b78-40db-bfaf-ea6ee7c60712 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:02.932469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376821-5b78-40db-bfaf-ea6ee7c60712 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:02.932756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376821-5b78-40db-bfaf-ea6ee7c60712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:02.939992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 922/1847] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:02 2022] PUT /identity/v3/projects/58b38020e36d4e76b7797879f6f24309/users/f63f486b29ef46909332bd969c51e48b/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:02.941440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014f872-179d-4871-b808-0348a3d2c45d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:02.961506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4e376821-5b78-40db-bfaf-ea6ee7c60712 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:02.962845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4e376821-5b78-40db-bfaf-ea6ee7c60712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:03.015424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:03.034859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014f872-179d-4871-b808-0348a3d2c45d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.038274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 926/1848] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:03.039884 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed755083-d4ca-4732-932a-6d533c405eba None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.040171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed755083-d4ca-4732-932a-6d533c405eba None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.040443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed755083-d4ca-4732-932a-6d533c405eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.043315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd657fc-b4cd-4b32-84d1-9458940eaf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.043984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd657fc-b4cd-4b32-84d1-9458940eaf7f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.044264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd657fc-b4cd-4b32-84d1-9458940eaf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.044553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd657fc-b4cd-4b32-84d1-9458940eaf7f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.045171 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd657fc-b4cd-4b32-84d1-9458940eaf7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.047227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd657fc-b4cd-4b32-84d1-9458940eaf7f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.061249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ed755083-d4ca-4732-932a-6d533c405eba None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:03.062733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ed755083-d4ca-4732-932a-6d533c405eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:03.071975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 923/1849] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:02 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:03.075393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063671b5-dc5f-4e0b-9ec0-5a7a4e6026cf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.075393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063671b5-dc5f-4e0b-9ec0-5a7a4e6026cf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.075393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063671b5-dc5f-4e0b-9ec0-5a7a4e6026cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.075645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 927/1850] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:03.076435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed755083-d4ca-4732-932a-6d533c405eba None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.087182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed755083-d4ca-4732-932a-6d533c405eba None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.092170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac6c8d-aaec-4f53-b9cd-5c5d7742a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.092781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac6c8d-aaec-4f53-b9cd-5c5d7742a51b admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.093058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac6c8d-aaec-4f53-b9cd-5c5d7742a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.093330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac6c8d-aaec-4f53-b9cd-5c5d7742a51b admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.093977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac6c8d-aaec-4f53-b9cd-5c5d7742a51b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:03.094276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac6c8d-aaec-4f53-b9cd-5c5d7742a51b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.095924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac6c8d-aaec-4f53-b9cd-5c5d7742a51b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.103138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-063671b5-dc5f-4e0b-9ec0-5a7a4e6026cf None None] MFA Rules not processed for user `f63f486b29ef46909332bd969c51e48b`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:03.104462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-063671b5-dc5f-4e0b-9ec0-5a7a4e6026cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:03.108616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 928/1851] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:03.109516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac6c8d-aaec-4f53-b9cd-5c5d7742a51b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.119509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac6c8d-aaec-4f53-b9cd-5c5d7742a51b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.124710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b26b0-b933-4f12-b13d-e044d604c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.125314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b26b0-b933-4f12-b13d-e044d604c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.125583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b26b0-b933-4f12-b13d-e044d604c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.125856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b26b0-b933-4f12-b13d-e044d604c6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.126521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b26b0-b933-4f12-b13d-e044d604c6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.128158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b26b0-b933-4f12-b13d-e044d604c6fb admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.138706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 929/1852] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:03.138706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b26b0-b933-4f12-b13d-e044d604c6fb admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.149831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b26b0-b933-4f12-b13d-e044d604c6fb admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.154781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7468-67c8-48ce-bfd5-5b34721996ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.155399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7468-67c8-48ce-bfd5-5b34721996ad admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.155680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7468-67c8-48ce-bfd5-5b34721996ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.155972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7468-67c8-48ce-bfd5-5b34721996ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.156607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7468-67c8-48ce-bfd5-5b34721996ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:03.156906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7468-67c8-48ce-bfd5-5b34721996ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.158493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7468-67c8-48ce-bfd5-5b34721996ad admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.170877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 930/1853] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:03.171792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7468-67c8-48ce-bfd5-5b34721996ad admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.171912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 924/1854] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:03.173333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063671b5-dc5f-4e0b-9ec0-5a7a4e6026cf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.184858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063671b5-dc5f-4e0b-9ec0-5a7a4e6026cf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.188134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7468-67c8-48ce-bfd5-5b34721996ad admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.189883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c73080-e365-479e-9976-feee832a3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.195362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c73080-e365-479e-9976-feee832a3001 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.195362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c73080-e365-479e-9976-feee832a3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.195362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c73080-e365-479e-9976-feee832a3001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.195362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c73080-e365-479e-9976-feee832a3001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.195362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c73080-e365-479e-9976-feee832a3001 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.200481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47010e34-c661-4940-931d-ce227dff984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.201183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47010e34-c661-4940-931d-ce227dff984e admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.201457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47010e34-c661-4940-931d-ce227dff984e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.201724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47010e34-c661-4940-931d-ce227dff984e admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.202376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47010e34-c661-4940-931d-ce227dff984e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.204328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47010e34-c661-4940-931d-ce227dff984e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.217754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 925/1855] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:03.217754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c73080-e365-479e-9976-feee832a3001 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.224649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c73080-e365-479e-9976-feee832a3001 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.230230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62b626-5993-42e4-9e41-560e48d3ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.230987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b626-5993-42e4-9e41-560e48d3ea01 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.231415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b626-5993-42e4-9e41-560e48d3ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.231692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b626-5993-42e4-9e41-560e48d3ea01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.232332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62b626-5993-42e4-9e41-560e48d3ea01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.234260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62b626-5993-42e4-9e41-560e48d3ea01 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.240831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 931/1856] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:03 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:03.240831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47010e34-c661-4940-931d-ce227dff984e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.240831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-47010e34-c661-4940-931d-ce227dff984e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:03.263014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 926/1857] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:03 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:03.264060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62b626-5993-42e4-9e41-560e48d3ea01 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.300861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47010e34-c661-4940-931d-ce227dff984e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.328048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62b626-5993-42e4-9e41-560e48d3ea01 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.330487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:03.333519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f558015-e64c-4e36-9f7c-c4da7b4955f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.334697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558015-e64c-4e36-9f7c-c4da7b4955f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.335069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558015-e64c-4e36-9f7c-c4da7b4955f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.335472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558015-e64c-4e36-9f7c-c4da7b4955f0 admin admin] PATH_INFO: `/v3/projects/826d093e962c4e13993801a47070a913/users/1f9ef63c0b6f46b9ba6c94dfa967c38f/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.352115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f558015-e64c-4e36-9f7c-c4da7b4955f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826d093e962c4e13993801a47070a913, user_id=1f9ef63c0b6f46b9ba6c94dfa967c38f, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.355216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f558015-e64c-4e36-9f7c-c4da7b4955f0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.360532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbf347-bc6d-48b6-8b16-689f15d00fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.361151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf347-bc6d-48b6-8b16-689f15d00fca service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.361429 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf347-bc6d-48b6-8b16-689f15d00fca service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.361720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf347-bc6d-48b6-8b16-689f15d00fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.370321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 927/1858] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:03 2022] PUT /identity/v3/projects/826d093e962c4e13993801a47070a913/users/1f9ef63c0b6f46b9ba6c94dfa967c38f/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:03.371056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f558015-e64c-4e36-9f7c-c4da7b4955f0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.393487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:03.419833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbf347-bc6d-48b6-8b16-689f15d00fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.421304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbf347-bc6d-48b6-8b16-689f15d00fca service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.432009 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 932/1859] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:03.433152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbf347-bc6d-48b6-8b16-689f15d00fca service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.445823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbf347-bc6d-48b6-8b16-689f15d00fca service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.446879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f558015-e64c-4e36-9f7c-c4da7b4955f0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.454527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777ff80-b3bb-45ec-95cf-07a60cd14200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.455224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ff80-b3bb-45ec-95cf-07a60cd14200 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.455436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99aec3-3eb4-40eb-9cf7-c79e5ec257bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.455554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ff80-b3bb-45ec-95cf-07a60cd14200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.455787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ff80-b3bb-45ec-95cf-07a60cd14200 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.456423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777ff80-b3bb-45ec-95cf-07a60cd14200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.456591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99aec3-3eb4-40eb-9cf7-c79e5ec257bc admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.456999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99aec3-3eb4-40eb-9cf7-c79e5ec257bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.457406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99aec3-3eb4-40eb-9cf7-c79e5ec257bc admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.458176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99aec3-3eb4-40eb-9cf7-c79e5ec257bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.458400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777ff80-b3bb-45ec-95cf-07a60cd14200 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.460585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99aec3-3eb4-40eb-9cf7-c79e5ec257bc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.497842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 928/1860] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:03 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:03.499363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292b4f-d2ce-43d5-92ee-0901ccd08775 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.499715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292b4f-d2ce-43d5-92ee-0901ccd08775 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.500049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292b4f-d2ce-43d5-92ee-0901ccd08775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.520889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 933/1861] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:03 2022] POST /identity/v3/users => generated 282 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:03.520889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777ff80-b3bb-45ec-95cf-07a60cd14200 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.533732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a7292b4f-d2ce-43d5-92ee-0901ccd08775 None None] MFA Rules not processed for user `1f9ef63c0b6f46b9ba6c94dfa967c38f`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:03.535203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a7292b4f-d2ce-43d5-92ee-0901ccd08775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:03.544311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777ff80-b3bb-45ec-95cf-07a60cd14200 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.549434 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.550314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.550736 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.551234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] PATH_INFO: `/v3/users/f63f486b29ef46909332bd969c51e48b` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.552968 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63f486b29ef46909332bd969c51e48b)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.555398 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.629841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 929/1862] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:03.629841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7292b4f-d2ce-43d5-92ee-0901ccd08775 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.641364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63f486b29ef46909332bd969c51e48b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:03.645558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7292b4f-d2ce-43d5-92ee-0901ccd08775 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.652868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69ae8f-22a3-441c-8530-dd91d632066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.655224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69ae8f-22a3-441c-8530-dd91d632066d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.655673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69ae8f-22a3-441c-8530-dd91d632066d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.656045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69ae8f-22a3-441c-8530-dd91d632066d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.656969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69ae8f-22a3-441c-8530-dd91d632066d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.658923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69ae8f-22a3-441c-8530-dd91d632066d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.661370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63f486b29ef46909332bd969c51e48b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:03.672146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63f486b29ef46909332bd969c51e48b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:03.673210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63f486b29ef46909332bd969c51e48b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:03.673971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63f486b29ef46909332bd969c51e48b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:03.677484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 930/1863] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:03.679109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69ae8f-22a3-441c-8530-dd91d632066d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.683006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0c69ae8f-22a3-441c-8530-dd91d632066d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:03.699767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 934/1864] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:03 2022] DELETE /identity/v3/users/f63f486b29ef46909332bd969c51e48b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:03.700220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.703288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69ae8f-22a3-441c-8530-dd91d632066d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.707999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:03.765436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:03.785553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b6e0c-ac36-4456-a9e7-6bc906f65ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.786949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6e0c-ac36-4456-a9e7-6bc906f65ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.787461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6e0c-ac36-4456-a9e7-6bc906f65ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.787903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6e0c-ac36-4456-a9e7-6bc906f65ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.789418 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b6e0c-ac36-4456-a9e7-6bc906f65ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.791879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b6e0c-ac36-4456-a9e7-6bc906f65ccf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.810109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 931/1865] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:03.811226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b6e0c-ac36-4456-a9e7-6bc906f65ccf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.814351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d78b6e0c-ac36-4456-a9e7-6bc906f65ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:03.818049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1d369-7a09-40d2-8dc0-f0898b0fe14f admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.825340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5537b0-7765-4bf6-be77-17733f749213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.826113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5537b0-7765-4bf6-be77-17733f749213 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.827418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5537b0-7765-4bf6-be77-17733f749213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.827816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5537b0-7765-4bf6-be77-17733f749213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.839577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5537b0-7765-4bf6-be77-17733f749213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.839577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5537b0-7765-4bf6-be77-17733f749213 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.841793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b6e0c-ac36-4456-a9e7-6bc906f65ccf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.850637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b36eb-d57f-457d-9b92-d90954fdc0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.851683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b36eb-d57f-457d-9b92-d90954fdc0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.852119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b36eb-d57f-457d-9b92-d90954fdc0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.852743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b36eb-d57f-457d-9b92-d90954fdc0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.853399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b36eb-d57f-457d-9b92-d90954fdc0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.855321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b36eb-d57f-457d-9b92-d90954fdc0d6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.869116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 935/1866] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:03 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:03.871556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c62e62-2528-4417-81df-8b9f9946d9ff None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.872115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c62e62-2528-4417-81df-8b9f9946d9ff None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.872612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c62e62-2528-4417-81df-8b9f9946d9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.875612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 932/1867] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:03.876549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b36eb-d57f-457d-9b92-d90954fdc0d6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:03.887438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b36eb-d57f-457d-9b92-d90954fdc0d6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:03.891911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:03.899793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-96c62e62-2528-4417-81df-8b9f9946d9ff None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:03.903666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-96c62e62-2528-4417-81df-8b9f9946d9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:03.977795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a573c23-0e66-4204-8da4-828553f1d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:03.978524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a573c23-0e66-4204-8da4-828553f1d579 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:03.978916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a573c23-0e66-4204-8da4-828553f1d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:03.979279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a573c23-0e66-4204-8da4-828553f1d579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:03.980788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a573c23-0e66-4204-8da4-828553f1d579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:03.982576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a573c23-0e66-4204-8da4-828553f1d579 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:03.993731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 933/1868] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:03.994660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a573c23-0e66-4204-8da4-828553f1d579 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.006007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a573c23-0e66-4204-8da4-828553f1d579 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.011158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1f917-97b6-4d68-a75f-ac043e22ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.011769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 936/1869] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:04.012149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1f917-97b6-4d68-a75f-ac043e22ff32 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.012487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1f917-97b6-4d68-a75f-ac043e22ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.012627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c62e62-2528-4417-81df-8b9f9946d9ff None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.012763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1f917-97b6-4d68-a75f-ac043e22ff32 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.013405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1f917-97b6-4d68-a75f-ac043e22ff32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.015346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1f917-97b6-4d68-a75f-ac043e22ff32 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.024914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c62e62-2528-4417-81df-8b9f9946d9ff None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.032996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e196c41-2375-4514-8b0e-51d7040ae6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.033760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e196c41-2375-4514-8b0e-51d7040ae6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.034156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e196c41-2375-4514-8b0e-51d7040ae6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.034445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e196c41-2375-4514-8b0e-51d7040ae6bc admin admin] PATH_INFO: `/v3/projects/0acadfc37cea496b8da6251a711f056d/users/e8165854522f409b9fb4327b8d09eca6/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.048376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 934/1870] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:03 2022] POST /identity/v3/users => generated 298 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:04.049198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1f917-97b6-4d68-a75f-ac043e22ff32 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.060174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e196c41-2375-4514-8b0e-51d7040ae6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acadfc37cea496b8da6251a711f056d, user_id=e8165854522f409b9fb4327b8d09eca6, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.063083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e196c41-2375-4514-8b0e-51d7040ae6bc admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.078927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1f917-97b6-4d68-a75f-ac043e22ff32 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.092737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 937/1871] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:04 2022] PUT /identity/v3/projects/0acadfc37cea496b8da6251a711f056d/users/e8165854522f409b9fb4327b8d09eca6/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:04.093855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e196c41-2375-4514-8b0e-51d7040ae6bc admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.104441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1e196c41-2375-4514-8b0e-51d7040ae6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:04.160941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b692c-0258-4ab6-8a68-fd089f0955c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.161945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b692c-0258-4ab6-8a68-fd089f0955c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.162055 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b692c-0258-4ab6-8a68-fd089f0955c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.162565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b692c-0258-4ab6-8a68-fd089f0955c0 admin admin] PATH_INFO: `/v3/projects/2253bf41281947cdb297cf8acbae184e/users/2a0d532c925548058ece2d039a12fc06/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.206008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e196c41-2375-4514-8b0e-51d7040ae6bc admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.209084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b692c-0258-4ab6-8a68-fd089f0955c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2253bf41281947cdb297cf8acbae184e, user_id=2a0d532c925548058ece2d039a12fc06, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.211425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b692c-0258-4ab6-8a68-fd089f0955c0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.218059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c7394-6183-43b0-8382-0f48f836bd06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.218792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c7394-6183-43b0-8382-0f48f836bd06 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.219170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c7394-6183-43b0-8382-0f48f836bd06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.219598 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c7394-6183-43b0-8382-0f48f836bd06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.240942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c7394-6183-43b0-8382-0f48f836bd06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.240942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c7394-6183-43b0-8382-0f48f836bd06 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.241227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 935/1872] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:04 2022] PUT /identity/v3/projects/2253bf41281947cdb297cf8acbae184e/users/2a0d532c925548058ece2d039a12fc06/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:04.241665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b692c-0258-4ab6-8a68-fd089f0955c0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.258707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 938/1873] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:04.261370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64120921-4d6b-4cf1-8c4d-fbf8aef2d8f8 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.261720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64120921-4d6b-4cf1-8c4d-fbf8aef2d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.262003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64120921-4d6b-4cf1-8c4d-fbf8aef2d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.316731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-64120921-4d6b-4cf1-8c4d-fbf8aef2d8f8 None None] MFA Rules not processed for user `e8165854522f409b9fb4327b8d09eca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:04.319025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-64120921-4d6b-4cf1-8c4d-fbf8aef2d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:04.362006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b692c-0258-4ab6-8a68-fd089f0955c0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.368593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae72c3-f787-4ed1-9641-33bb270e7051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.370453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae72c3-f787-4ed1-9641-33bb270e7051 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.370845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae72c3-f787-4ed1-9641-33bb270e7051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.371218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae72c3-f787-4ed1-9641-33bb270e7051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.372141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae72c3-f787-4ed1-9641-33bb270e7051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.373784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae72c3-f787-4ed1-9641-33bb270e7051 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.383497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:04.392215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 936/1874] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:04.392215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f7be5-ff64-4104-b15c-5ff140fa5a81 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.392215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f7be5-ff64-4104-b15c-5ff140fa5a81 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.392215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f7be5-ff64-4104-b15c-5ff140fa5a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.407078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:04.454897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-952f7be5-ff64-4104-b15c-5ff140fa5a81 None None] MFA Rules not processed for user `2a0d532c925548058ece2d039a12fc06`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:04.457077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-952f7be5-ff64-4104-b15c-5ff140fa5a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:04.471587 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 939/1875] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:04.472738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64120921-4d6b-4cf1-8c4d-fbf8aef2d8f8 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.509187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64120921-4d6b-4cf1-8c4d-fbf8aef2d8f8 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.520878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59450b01-3739-47b1-be25-22861a1f03dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.521284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450b01-3739-47b1-be25-22861a1f03dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.521588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450b01-3739-47b1-be25-22861a1f03dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.521841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450b01-3739-47b1-be25-22861a1f03dd admin admin] PATH_INFO: `/v3/projects/9a0cab3c1c434f89ac64374ff7265d4a/users/c30dc140c10149d7a77f51439ecf92d6/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.541856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59450b01-3739-47b1-be25-22861a1f03dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0cab3c1c434f89ac64374ff7265d4a, user_id=c30dc140c10149d7a77f51439ecf92d6, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.545608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59450b01-3739-47b1-be25-22861a1f03dd admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.567771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 940/1876] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:04 2022] PUT /identity/v3/projects/9a0cab3c1c434f89ac64374ff7265d4a/users/c30dc140c10149d7a77f51439ecf92d6/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:04.568849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59450b01-3739-47b1-be25-22861a1f03dd admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.573814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-59450b01-3739-47b1-be25-22861a1f03dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:04.596769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 937/1877] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:04.596769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f7be5-ff64-4104-b15c-5ff140fa5a81 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.611245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f7be5-ff64-4104-b15c-5ff140fa5a81 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.654306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59450b01-3739-47b1-be25-22861a1f03dd admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.658215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec93a44-cc1e-4fa9-a089-45d212632905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.658886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93a44-cc1e-4fa9-a089-45d212632905 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.659166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93a44-cc1e-4fa9-a089-45d212632905 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.659483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93a44-cc1e-4fa9-a089-45d212632905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.688143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0abe13-ab91-4b38-9dfa-06f4d4b44119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.689668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0abe13-ab91-4b38-9dfa-06f4d4b44119 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.689668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0abe13-ab91-4b38-9dfa-06f4d4b44119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.690135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0abe13-ab91-4b38-9dfa-06f4d4b44119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.691114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0abe13-ab91-4b38-9dfa-06f4d4b44119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.693934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0abe13-ab91-4b38-9dfa-06f4d4b44119 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.710467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 938/1878] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:04.711890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0abe13-ab91-4b38-9dfa-06f4d4b44119 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.741896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec93a44-cc1e-4fa9-a089-45d212632905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.743507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec93a44-cc1e-4fa9-a089-45d212632905 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.743627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0abe13-ab91-4b38-9dfa-06f4d4b44119 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.758204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312ad0-781b-4c3c-8def-928acd6936b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.759067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312ad0-781b-4c3c-8def-928acd6936b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.759580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312ad0-781b-4c3c-8def-928acd6936b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.760167 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312ad0-781b-4c3c-8def-928acd6936b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.763441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d312ad0-781b-4c3c-8def-928acd6936b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.767968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d312ad0-781b-4c3c-8def-928acd6936b7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.769025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 941/1879] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:04.769909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec93a44-cc1e-4fa9-a089-45d212632905 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.819311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec93a44-cc1e-4fa9-a089-45d212632905 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.823859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 939/1880] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:04 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:04.825076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312ad0-781b-4c3c-8def-928acd6936b7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:04.826877 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1d312ad0-781b-4c3c-8def-928acd6936b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:04.908927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312ad0-781b-4c3c-8def-928acd6936b7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:04.915397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.916223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.921736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.921736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] PATH_INFO: `/v3/projects/58b38020e36d4e76b7797879f6f24309` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.921736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b38020e36d4e76b7797879f6f24309)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.921736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.924596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5aa1e-6bf0-4740-a262-2f579d8d96e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:04.925859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5aa1e-6bf0-4740-a262-2f579d8d96e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:04.926397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5aa1e-6bf0-4740-a262-2f579d8d96e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:04.926924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5aa1e-6bf0-4740-a262-2f579d8d96e2 admin admin] PATH_INFO: `/v3/projects/9a0cab3c1c434f89ac64374ff7265d4a/users/c30dc140c10149d7a77f51439ecf92d6/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:04.940176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5aa1e-6bf0-4740-a262-2f579d8d96e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0cab3c1c434f89ac64374ff7265d4a, user_id=c30dc140c10149d7a77f51439ecf92d6, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:04.944648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:04.949138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5aa1e-6bf0-4740-a262-2f579d8d96e2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:04.953623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:04.987682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 942/1881] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:04 2022] PUT /identity/v3/projects/9a0cab3c1c434f89ac64374ff7265d4a/users/c30dc140c10149d7a77f51439ecf92d6/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:04.989055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5aa1e-6bf0-4740-a262-2f579d8d96e2 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.017164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b38020e36d4e76b7797879f6f24309', 'request_id': 'req-ddb7f0ac-4068-4815-98c1-24c831c7c583'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.029302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b38020e36d4e76b7797879f6f24309', 'request_id': 'req-ddb7f0ac-4068-4815-98c1-24c831c7c583'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.040591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b38020e36d4e76b7797879f6f24309', 'request_id': 'req-ddb7f0ac-4068-4815-98c1-24c831c7c583'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.061475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] The token cache is being invalidate because project 58b38020e36d4e76b7797879f6f24309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:05.062000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.062721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.064507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 940/1882] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:04 2022] DELETE /identity/v3/projects/58b38020e36d4e76b7797879f6f24309 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:05.065386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.067000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:05.074581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5aa1e-6bf0-4740-a262-2f579d8d96e2 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.140332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.140974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.141254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.141535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] PATH_INFO: `/v3/users/e8165854522f409b9fb4327b8d09eca6` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.142253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7f0ac-4068-4815-98c1-24c831c7c583 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.142650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8165854522f409b9fb4327b8d09eca6)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.144645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.147574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79c72a-cf72-450f-b464-8c458a67dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.147827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79c72a-cf72-450f-b464-8c458a67dc16 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.148095 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79c72a-cf72-450f-b464-8c458a67dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.148382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79c72a-cf72-450f-b464-8c458a67dc16 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.149467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79c72a-cf72-450f-b464-8c458a67dc16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.150948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79c72a-cf72-450f-b464-8c458a67dc16 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.173829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 941/1883] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:05 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:05.175485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057de701-d01f-4c92-92aa-4413039dc357 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.175972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057de701-d01f-4c92-92aa-4413039dc357 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.176405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057de701-d01f-4c92-92aa-4413039dc357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.211308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-057de701-d01f-4c92-92aa-4413039dc357 None None] MFA Rules not processed for user `c30dc140c10149d7a77f51439ecf92d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:05.212794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-057de701-d01f-4c92-92aa-4413039dc357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:05.215228 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8165854522f409b9fb4327b8d09eca6'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.230264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8165854522f409b9fb4327b8d09eca6'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.238574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8165854522f409b9fb4327b8d09eca6'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.239589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8165854522f409b9fb4327b8d09eca6'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.239982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e5dada3f-7bb8-41de-a13e-02693d221207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8165854522f409b9fb4327b8d09eca6'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.266637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 943/1884] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:04 2022] DELETE /identity/v3/users/e8165854522f409b9fb4327b8d09eca6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:05.270856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5ff5d-56a2-45bb-8546-e9bfed43c339 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.271423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5ff5d-56a2-45bb-8546-e9bfed43c339 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.271704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5ff5d-56a2-45bb-8546-e9bfed43c339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.311371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-44f5ff5d-56a2-45bb-8546-e9bfed43c339 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:05.311776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 942/1885] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:05.312838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-44f5ff5d-56a2-45bb-8546-e9bfed43c339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:05.313039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057de701-d01f-4c92-92aa-4413039dc357 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.314935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-057de701-d01f-4c92-92aa-4413039dc357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:05.333759 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057de701-d01f-4c92-92aa-4413039dc357 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.335707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:05.345396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:05.403401 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 944/1886] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:05.405666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d792-0318-4418-8248-631b331bdfda None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.406138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d792-0318-4418-8248-631b331bdfda None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.406548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d792-0318-4418-8248-631b331bdfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.423967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90d87f-b9bb-48b2-ab78-8c3e0ff23a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.424600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90d87f-b9bb-48b2-ab78-8c3e0ff23a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.424881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90d87f-b9bb-48b2-ab78-8c3e0ff23a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.425154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90d87f-b9bb-48b2-ab78-8c3e0ff23a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.425808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90d87f-b9bb-48b2-ab78-8c3e0ff23a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.427605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90d87f-b9bb-48b2-ab78-8c3e0ff23a27 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.439594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7988d792-0318-4418-8248-631b331bdfda None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:05.440797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7988d792-0318-4418-8248-631b331bdfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:05.444110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 943/1887] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:05.445046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90d87f-b9bb-48b2-ab78-8c3e0ff23a27 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.446909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5d90d87f-b9bb-48b2-ab78-8c3e0ff23a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:05.452120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 945/1888] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:05.453226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeffaff-2291-4fce-98a0-39f717bea9ce None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.453509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeffaff-2291-4fce-98a0-39f717bea9ce None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.453825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeffaff-2291-4fce-98a0-39f717bea9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.474623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-efeffaff-2291-4fce-98a0-39f717bea9ce None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:05.475872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-efeffaff-2291-4fce-98a0-39f717bea9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:05.485504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 946/1889] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:05.486368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeffaff-2291-4fce-98a0-39f717bea9ce None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.496012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeffaff-2291-4fce-98a0-39f717bea9ce None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.500696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eb5fa-5d30-44bb-a618-0625a9d45ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.501816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb5fa-5d30-44bb-a618-0625a9d45ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.501816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb5fa-5d30-44bb-a618-0625a9d45ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.501816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb5fa-5d30-44bb-a618-0625a9d45ea9 admin admin] PATH_INFO: `/v3/projects/e86bd837df884470ae0c3e1513aff560/users/b6a8dead124d450ba4edba76218a7abd/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.518648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eb5fa-5d30-44bb-a618-0625a9d45ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86bd837df884470ae0c3e1513aff560, user_id=b6a8dead124d450ba4edba76218a7abd, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.521469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eb5fa-5d30-44bb-a618-0625a9d45ea9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.524097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90d87f-b9bb-48b2-ab78-8c3e0ff23a27 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.528448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ee848-bd0d-4d36-a12b-a4a68ccf91f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.529201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ee848-bd0d-4d36-a12b-a4a68ccf91f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.529544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ee848-bd0d-4d36-a12b-a4a68ccf91f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.529923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ee848-bd0d-4d36-a12b-a4a68ccf91f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.537640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 947/1890] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:05 2022] PUT /identity/v3/projects/e86bd837df884470ae0c3e1513aff560/users/b6a8dead124d450ba4edba76218a7abd/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:05.538400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eb5fa-5d30-44bb-a618-0625a9d45ea9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.540197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-853eb5fa-5d30-44bb-a618-0625a9d45ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:05.602990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ee848-bd0d-4d36-a12b-a4a68ccf91f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.605168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ee848-bd0d-4d36-a12b-a4a68ccf91f5 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.606974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eb5fa-5d30-44bb-a618-0625a9d45ea9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.611585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24508a0d-5917-4c8a-88a4-46b1e0fb2e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.612238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24508a0d-5917-4c8a-88a4-46b1e0fb2e1d service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.612520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24508a0d-5917-4c8a-88a4-46b1e0fb2e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.612795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24508a0d-5917-4c8a-88a4-46b1e0fb2e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.616523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 944/1891] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:05.617563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ee848-bd0d-4d36-a12b-a4a68ccf91f5 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.629303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ee848-bd0d-4d36-a12b-a4a68ccf91f5 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.687136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24508a0d-5917-4c8a-88a4-46b1e0fb2e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.689292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24508a0d-5917-4c8a-88a4-46b1e0fb2e1d service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.699893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 948/1892] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:05.700910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24508a0d-5917-4c8a-88a4-46b1e0fb2e1d service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.705568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178d210-7e4e-4c6a-af4f-6447fcfcc6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.706340 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178d210-7e4e-4c6a-af4f-6447fcfcc6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.706620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178d210-7e4e-4c6a-af4f-6447fcfcc6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.706894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178d210-7e4e-4c6a-af4f-6447fcfcc6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.707588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178d210-7e4e-4c6a-af4f-6447fcfcc6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:05.707939 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178d210-7e4e-4c6a-af4f-6447fcfcc6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.709901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178d210-7e4e-4c6a-af4f-6447fcfcc6e8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.712061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:05.712433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24508a0d-5917-4c8a-88a4-46b1e0fb2e1d service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.719285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f21c8-0bcd-4063-929d-c15a14ff78b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.720597 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f21c8-0bcd-4063-929d-c15a14ff78b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.721052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f21c8-0bcd-4063-929d-c15a14ff78b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.721523 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f21c8-0bcd-4063-929d-c15a14ff78b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.722739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f21c8-0bcd-4063-929d-c15a14ff78b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.724531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f21c8-0bcd-4063-929d-c15a14ff78b3 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.730658 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 945/1893] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:05.731845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178d210-7e4e-4c6a-af4f-6447fcfcc6e8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.734309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a178d210-7e4e-4c6a-af4f-6447fcfcc6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:05.741106 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 949/1894] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:05.741708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f21c8-0bcd-4063-929d-c15a14ff78b3 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.755608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178d210-7e4e-4c6a-af4f-6447fcfcc6e8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.759728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f21c8-0bcd-4063-929d-c15a14ff78b3 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.761900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.762715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.763326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.763751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] PATH_INFO: `/v3/users/1f9ef63c0b6f46b9ba6c94dfa967c38f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.765898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9ef63c0b6f46b9ba6c94dfa967c38f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.767889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0c8a8-681d-498f-91ec-cfb54fd72d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.768170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.769232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0c8a8-681d-498f-91ec-cfb54fd72d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.769504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0c8a8-681d-498f-91ec-cfb54fd72d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.770062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0c8a8-681d-498f-91ec-cfb54fd72d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.771002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0c8a8-681d-498f-91ec-cfb54fd72d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.777065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0c8a8-681d-498f-91ec-cfb54fd72d87 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.805771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:05.820406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 950/1895] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:05 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:05.820406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0c8a8-681d-498f-91ec-cfb54fd72d87 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.867539 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9ef63c0b6f46b9ba6c94dfa967c38f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.888619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9ef63c0b6f46b9ba6c94dfa967c38f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.907976 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9ef63c0b6f46b9ba6c94dfa967c38f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.909561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9ef63c0b6f46b9ba6c94dfa967c38f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.910789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9ef63c0b6f46b9ba6c94dfa967c38f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:05.939820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0c8a8-681d-498f-91ec-cfb54fd72d87 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:05.946061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c408a6d-a2b2-4b1e-bdc4-e7b6c4a63f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:05.946889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c408a6d-a2b2-4b1e-bdc4-e7b6c4a63f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.947181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c408a6d-a2b2-4b1e-bdc4-e7b6c4a63f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.947479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c408a6d-a2b2-4b1e-bdc4-e7b6c4a63f67 admin admin] PATH_INFO: `/v3/projects/e86bd837df884470ae0c3e1513aff560/users/b6a8dead124d450ba4edba76218a7abd/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:05.950797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c408a6d-a2b2-4b1e-bdc4-e7b6c4a63f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86bd837df884470ae0c3e1513aff560, user_id=b6a8dead124d450ba4edba76218a7abd, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:05.951430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 946/1896] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:05 2022] DELETE /identity/v3/users/1f9ef63c0b6f46b9ba6c94dfa967c38f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:05.952479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:05.954419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:05.954787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c408a6d-a2b2-4b1e-bdc4-e7b6c4a63f67 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:05.975359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 951/1897] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:05 2022] PUT /identity/v3/projects/e86bd837df884470ae0c3e1513aff560/users/b6a8dead124d450ba4edba76218a7abd/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:05.977513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ff16-a2df-476b-b2cb-58136472aa51 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:05.986636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ff16-a2df-476b-b2cb-58136472aa51 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:05.987014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ff16-a2df-476b-b2cb-58136472aa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.018474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a512ff16-a2df-476b-b2cb-58136472aa51 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:06.019781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a512ff16-a2df-476b-b2cb-58136472aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.111313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 952/1898] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:06.112747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2c1ce-378e-46f8-8dc1-dac7d9314ec8 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.113044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2c1ce-378e-46f8-8dc1-dac7d9314ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.113324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2c1ce-378e-46f8-8dc1-dac7d9314ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.114815 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6dc82-b7c4-4acf-bfb8-259d29d3abeb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.123978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f23e78-249b-4e0a-b0b0-3b58a7a57184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.126293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f23e78-249b-4e0a-b0b0-3b58a7a57184 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.126587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f23e78-249b-4e0a-b0b0-3b58a7a57184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.126862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f23e78-249b-4e0a-b0b0-3b58a7a57184 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.129371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f23e78-249b-4e0a-b0b0-3b58a7a57184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:06.135332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f23e78-249b-4e0a-b0b0-3b58a7a57184 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:06.148512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-bbc2c1ce-378e-46f8-8dc1-dac7d9314ec8 None None] MFA Rules not processed for user `b6a8dead124d450ba4edba76218a7abd`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:06.150675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bbc2c1ce-378e-46f8-8dc1-dac7d9314ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.262142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 947/1899] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:05 2022] POST /identity/v3/users => generated 288 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:06.265142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f23e78-249b-4e0a-b0b0-3b58a7a57184 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.269953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e1f23e78-249b-4e0a-b0b0-3b58a7a57184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.289801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f23e78-249b-4e0a-b0b0-3b58a7a57184 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.298365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.298810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.299094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.299408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] PATH_INFO: `/v3/projects/0acadfc37cea496b8da6251a711f056d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.301120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acadfc37cea496b8da6251a711f056d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:06.303556 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:06.346317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 953/1900] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:06.347692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2c1ce-378e-46f8-8dc1-dac7d9314ec8 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.366051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bbc2c1ce-378e-46f8-8dc1-dac7d9314ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.380575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2c1ce-378e-46f8-8dc1-dac7d9314ec8 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.391403 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acadfc37cea496b8da6251a711f056d', 'request_id': 'req-32fe0775-bf4c-497d-9722-740cbeaca3d6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:06.393296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:06.400520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:06.404136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acadfc37cea496b8da6251a711f056d', 'request_id': 'req-32fe0775-bf4c-497d-9722-740cbeaca3d6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:06.412520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acadfc37cea496b8da6251a711f056d', 'request_id': 'req-32fe0775-bf4c-497d-9722-740cbeaca3d6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:06.426819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] The token cache is being invalidate because project 0acadfc37cea496b8da6251a711f056d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:06.427184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:06.427889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:06.433236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 948/1901] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:06 2022] DELETE /identity/v3/projects/0acadfc37cea496b8da6251a711f056d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:06.433236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.433236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.453210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.453863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.454141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.454414 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] PATH_INFO: `/v3/users/e1d4c5d0ca5445f7b30a7eddd276fae1` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.455613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d4c5d0ca5445f7b30a7eddd276fae1)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:06.457739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:06.515314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe0775-bf4c-497d-9722-740cbeaca3d6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.520965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff2fa-66ae-42a9-a21c-5f674c6a3415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.521437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d4c5d0ca5445f7b30a7eddd276fae1'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:06.522100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff2fa-66ae-42a9-a21c-5f674c6a3415 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.522370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff2fa-66ae-42a9-a21c-5f674c6a3415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.522741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff2fa-66ae-42a9-a21c-5f674c6a3415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.524854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b37ff2fa-66ae-42a9-a21c-5f674c6a3415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.534719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d4c5d0ca5445f7b30a7eddd276fae1'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:06.537413 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ff2fa-66ae-42a9-a21c-5f674c6a3415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:06.538910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ff2fa-66ae-42a9-a21c-5f674c6a3415 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:06.544942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d4c5d0ca5445f7b30a7eddd276fae1'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:06.545796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d4c5d0ca5445f7b30a7eddd276fae1'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:06.547031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d4c5d0ca5445f7b30a7eddd276fae1'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:06.549192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 949/1902] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:06.556577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff2fa-66ae-42a9-a21c-5f674c6a3415 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.560893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b37ff2fa-66ae-42a9-a21c-5f674c6a3415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.573500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff2fa-66ae-42a9-a21c-5f674c6a3415 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.574784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 954/1903] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:06 2022] DELETE /identity/v3/users/e1d4c5d0ca5445f7b30a7eddd276fae1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:06.576492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.581070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.658675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99714880-193d-43d6-abb7-d902341c6f65 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.663233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc260-dd62-4388-88a3-825d29e01ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.664163 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc260-dd62-4388-88a3-825d29e01ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.664513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc260-dd62-4388-88a3-825d29e01ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.664895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc260-dd62-4388-88a3-825d29e01ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.666694 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ed1dc260-dd62-4388-88a3-825d29e01ed0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.671870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301d68d-5aab-4f0b-ad66-bc3c79c89fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.672680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d68d-5aab-4f0b-ad66-bc3c79c89fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.672797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d68d-5aab-4f0b-ad66-bc3c79c89fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.673157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d68d-5aab-4f0b-ad66-bc3c79c89fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.674163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301d68d-5aab-4f0b-ad66-bc3c79c89fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:06.675560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301d68d-5aab-4f0b-ad66-bc3c79c89fbb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:06.689214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 950/1904] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:06.689214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab0f50-1862-4775-84de-40eeed77fca5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.689214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab0f50-1862-4775-84de-40eeed77fca5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.689214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab0f50-1862-4775-84de-40eeed77fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.709455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-14ab0f50-1862-4775-84de-40eeed77fca5 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:06.710686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-14ab0f50-1862-4775-84de-40eeed77fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.732538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 951/1905] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:06.733087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:06.735150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53403fd-900f-4b45-b320-30651885426d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.735492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53403fd-900f-4b45-b320-30651885426d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.735815 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53403fd-900f-4b45-b320-30651885426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.752496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1dc260-dd62-4388-88a3-825d29e01ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:06.754612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1dc260-dd62-4388-88a3-825d29e01ed0 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:06.758122 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b53403fd-900f-4b45-b320-30651885426d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:06.759363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b53403fd-900f-4b45-b320-30651885426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.767801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 955/1906] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:06.768080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 952/1907] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:06.769117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc260-dd62-4388-88a3-825d29e01ed0 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.769323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704c355-bd89-4066-a1cf-3c1e714ffd22 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.769605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704c355-bd89-4066-a1cf-3c1e714ffd22 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.769879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704c355-bd89-4066-a1cf-3c1e714ffd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.778511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ed1dc260-dd62-4388-88a3-825d29e01ed0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.790224 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c704c355-bd89-4066-a1cf-3c1e714ffd22 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:06.791583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c704c355-bd89-4066-a1cf-3c1e714ffd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.794165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc260-dd62-4388-88a3-825d29e01ed0 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.799817 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5626-a67e-40b4-8d9b-f17d380332ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.801044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5626-a67e-40b4-8d9b-f17d380332ca admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.801154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 953/1908] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:06.801606 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704c355-bd89-4066-a1cf-3c1e714ffd22 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.802897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c704c355-bd89-4066-a1cf-3c1e714ffd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:06.804358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5626-a67e-40b4-8d9b-f17d380332ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.804671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5626-a67e-40b4-8d9b-f17d380332ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.805367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5626-a67e-40b4-8d9b-f17d380332ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:06.807027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5626-a67e-40b4-8d9b-f17d380332ca admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:06.824528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 956/1909] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:06.825470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5626-a67e-40b4-8d9b-f17d380332ca admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.836375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5626-a67e-40b4-8d9b-f17d380332ca admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.842161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f818b-c759-444f-96e4-248fca772141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.842852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f818b-c759-444f-96e4-248fca772141 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.843323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f818b-c759-444f-96e4-248fca772141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.843500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f818b-c759-444f-96e4-248fca772141 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.844147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f818b-c759-444f-96e4-248fca772141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:06.844446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f818b-c759-444f-96e4-248fca772141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:06.846328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f818b-c759-444f-96e4-248fca772141 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:06.861031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 957/1910] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:06.861861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f818b-c759-444f-96e4-248fca772141 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.873711 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f818b-c759-444f-96e4-248fca772141 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.881297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f30ffa-e402-4c69-bf98-e54fda288c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.881955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f30ffa-e402-4c69-bf98-e54fda288c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.882229 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f30ffa-e402-4c69-bf98-e54fda288c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.882497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f30ffa-e402-4c69-bf98-e54fda288c7e admin admin] PATH_INFO: `/v3/projects/f81831b7b5194a2cbe545cd122e4be3e/users/b3474a511bc242669f8b92a5c6cb0aa9/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.890217 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704c355-bd89-4066-a1cf-3c1e714ffd22 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.894057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af47ce2-16a3-438d-9427-93cd21b2cc2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.894888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af47ce2-16a3-438d-9427-93cd21b2cc2e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.895178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af47ce2-16a3-438d-9427-93cd21b2cc2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.895546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af47ce2-16a3-438d-9427-93cd21b2cc2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.898997 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f30ffa-e402-4c69-bf98-e54fda288c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81831b7b5194a2cbe545cd122e4be3e, user_id=b3474a511bc242669f8b92a5c6cb0aa9, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:06.902044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f30ffa-e402-4c69-bf98-e54fda288c7e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:06.907937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af47ce2-16a3-438d-9427-93cd21b2cc2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:06.909574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af47ce2-16a3-438d-9427-93cd21b2cc2e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:06.916273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:06.921303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 958/1911] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:06 2022] PUT /identity/v3/projects/f81831b7b5194a2cbe545cd122e4be3e/users/b3474a511bc242669f8b92a5c6cb0aa9/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:06.922224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f30ffa-e402-4c69-bf98-e54fda288c7e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.922797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 954/1912] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:06.923656 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af47ce2-16a3-438d-9427-93cd21b2cc2e service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:06.934267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af47ce2-16a3-438d-9427-93cd21b2cc2e service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:06.993809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f756b-46dd-4ced-85aa-8121ba6079dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:06.994235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f756b-46dd-4ced-85aa-8121ba6079dc service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:06.994551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f756b-46dd-4ced-85aa-8121ba6079dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:06.994829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f756b-46dd-4ced-85aa-8121ba6079dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:06.997601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f61f756b-46dd-4ced-85aa-8121ba6079dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:07.011066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f30ffa-e402-4c69-bf98-e54fda288c7e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:07.016845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e0cbe-5ecc-4454-9005-5f3f9ec9c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:07.017830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e0cbe-5ecc-4454-9005-5f3f9ec9c2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:07.018433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e0cbe-5ecc-4454-9005-5f3f9ec9c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:07.018433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e0cbe-5ecc-4454-9005-5f3f9ec9c2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:07.019378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e0cbe-5ecc-4454-9005-5f3f9ec9c2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:07.021627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e0cbe-5ecc-4454-9005-5f3f9ec9c2a7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:07.054922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 959/1913] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:06 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:07.055941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e0cbe-5ecc-4454-9005-5f3f9ec9c2a7 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:07.058218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-986e0cbe-5ecc-4454-9005-5f3f9ec9c2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:07.066060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f756b-46dd-4ced-85aa-8121ba6079dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:07.069637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f756b-46dd-4ced-85aa-8121ba6079dc service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:07.078375 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 955/1914] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:07.079717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd32ff-17af-48d1-9013-aeef52fa4f54 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:07.079983 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd32ff-17af-48d1-9013-aeef52fa4f54 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:07.080260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd32ff-17af-48d1-9013-aeef52fa4f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:07.114485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3cfd32ff-17af-48d1-9013-aeef52fa4f54 None None] MFA Rules not processed for user `b3474a511bc242669f8b92a5c6cb0aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:07.115882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3cfd32ff-17af-48d1-9013-aeef52fa4f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:07.154699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e0cbe-5ecc-4454-9005-5f3f9ec9c2a7 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:07.161164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:07.162226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:07.162552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:07.162829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] PATH_INFO: `/v3/projects/826d093e962c4e13993801a47070a913` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:07.164101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=826d093e962c4e13993801a47070a913)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:07.167397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:07.217427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:07.221719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 956/1915] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:07.222758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd32ff-17af-48d1-9013-aeef52fa4f54 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:07.249565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826d093e962c4e13993801a47070a913', 'request_id': 'req-85c0b37e-d98e-4054-885f-46ee3f348a60'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.254638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd32ff-17af-48d1-9013-aeef52fa4f54 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:07.262548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826d093e962c4e13993801a47070a913', 'request_id': 'req-85c0b37e-d98e-4054-885f-46ee3f348a60'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.271109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826d093e962c4e13993801a47070a913', 'request_id': 'req-85c0b37e-d98e-4054-885f-46ee3f348a60'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.287790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] The token cache is being invalidate because project 826d093e962c4e13993801a47070a913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:07.288249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.289122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.292046 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 960/1916] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:07 2022] DELETE /identity/v3/projects/826d093e962c4e13993801a47070a913 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:07.293152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:07.294686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:07.342067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:07.361797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ee3b4-8207-48bb-8092-ea83e954fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:07.362563 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ee3b4-8207-48bb-8092-ea83e954fd9f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:07.362840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ee3b4-8207-48bb-8092-ea83e954fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:07.363113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ee3b4-8207-48bb-8092-ea83e954fd9f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:07.364004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ee3b4-8207-48bb-8092-ea83e954fd9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:07.370663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ee3b4-8207-48bb-8092-ea83e954fd9f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:07.410795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 957/1917] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:07 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:07.412617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ee3b4-8207-48bb-8092-ea83e954fd9f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:07.415667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0b37e-d98e-4054-885f-46ee3f348a60 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:07.419368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a57ee3b4-8207-48bb-8092-ea83e954fd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:07.427173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ba456-85bc-4d84-a762-77f237faf6db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:07.427834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ba456-85bc-4d84-a762-77f237faf6db service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:07.428112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ba456-85bc-4d84-a762-77f237faf6db service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:07.428654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ba456-85bc-4d84-a762-77f237faf6db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:07.433732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-187ba456-85bc-4d84-a762-77f237faf6db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:07.441911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ee3b4-8207-48bb-8092-ea83e954fd9f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:07.464049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:07.465460 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:07.466443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:07.466443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] PATH_INFO: `/v3/projects/3ed07a7365bd4816909b84a48eaeafd7` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:07.470094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed07a7365bd4816909b84a48eaeafd7)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:07.476371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:07.562114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed07a7365bd4816909b84a48eaeafd7', 'request_id': 'req-01429042-4072-44be-a27e-89d2f0587cb9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.575329 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed07a7365bd4816909b84a48eaeafd7', 'request_id': 'req-01429042-4072-44be-a27e-89d2f0587cb9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.593838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed07a7365bd4816909b84a48eaeafd7', 'request_id': 'req-01429042-4072-44be-a27e-89d2f0587cb9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.614507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] The token cache is being invalidate because project 3ed07a7365bd4816909b84a48eaeafd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:07.614851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.615609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.617278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 958/1918] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:07 2022] DELETE /identity/v3/projects/3ed07a7365bd4816909b84a48eaeafd7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:07.622372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:07.624139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:07.625547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ba456-85bc-4d84-a762-77f237faf6db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:07.628820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ba456-85bc-4d84-a762-77f237faf6db service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:07.641119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 961/1919] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:07.642221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ba456-85bc-4d84-a762-77f237faf6db service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:07.644024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-187ba456-85bc-4d84-a762-77f237faf6db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:07.690621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ba456-85bc-4d84-a762-77f237faf6db service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:07.722852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01429042-4072-44be-a27e-89d2f0587cb9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:07.729287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:07.730998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:07.731511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:07.732007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] PATH_INFO: `/v3/users/c30dc140c10149d7a77f51439ecf92d6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:07.733454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30dc140c10149d7a77f51439ecf92d6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:07.735620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:07.796507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984386b-2850-4efb-8d2d-4bd9ba3a4fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:07.797067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984386b-2850-4efb-8d2d-4bd9ba3a4fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:07.797426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984386b-2850-4efb-8d2d-4bd9ba3a4fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:07.798181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984386b-2850-4efb-8d2d-4bd9ba3a4fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:07.798611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984386b-2850-4efb-8d2d-4bd9ba3a4fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:07.800693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984386b-2850-4efb-8d2d-4bd9ba3a4fe1 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:07.816186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 962/1920] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:07.816676 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984386b-2850-4efb-8d2d-4bd9ba3a4fe1 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:07.818503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9984386b-2850-4efb-8d2d-4bd9ba3a4fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:07.828469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30dc140c10149d7a77f51439ecf92d6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.839455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984386b-2850-4efb-8d2d-4bd9ba3a4fe1 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:07.847809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:07.855803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:07.856462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:07.856735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:07.857000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] PATH_INFO: `/v3/users/9671e60398a34359a05ac4ecda7483e8` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:07.858146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9671e60398a34359a05ac4ecda7483e8)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:07.860114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:07.860555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30dc140c10149d7a77f51439ecf92d6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.864304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:07.876242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30dc140c10149d7a77f51439ecf92d6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.877520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30dc140c10149d7a77f51439ecf92d6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.878332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe67a782-36c5-4766-bc6b-238dd39c63b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30dc140c10149d7a77f51439ecf92d6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:07.923970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 959/1921] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:07 2022] DELETE /identity/v3/users/c30dc140c10149d7a77f51439ecf92d6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:07.926977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03c45-625f-43d1-ac02-8f82ab6960c8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:07.927760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03c45-625f-43d1-ac02-8f82ab6960c8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:07.929061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03c45-625f-43d1-ac02-8f82ab6960c8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:07.930401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 960/1922] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:23:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:23:07.932045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d03c45-625f-43d1-ac02-8f82ab6960c8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:07.933140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-44d03c45-625f-43d1-ac02-8f82ab6960c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:07.976253 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9671e60398a34359a05ac4ecda7483e8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:08.004047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9671e60398a34359a05ac4ecda7483e8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:08.025770 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9671e60398a34359a05ac4ecda7483e8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:08.027326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9671e60398a34359a05ac4ecda7483e8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:08.042909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-624eb0c1-9917-4c99-b5e8-f8a398d03e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9671e60398a34359a05ac4ecda7483e8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:08.067491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 963/1923] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:07 2022] DELETE /identity/v3/users/9671e60398a34359a05ac4ecda7483e8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:08.068372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d03c45-625f-43d1-ac02-8f82ab6960c8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:08.069059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdb187-82da-463e-a4d0-28a394b714a0 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:08.069389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdb187-82da-463e-a4d0-28a394b714a0 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:08.069897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdb187-82da-463e-a4d0-28a394b714a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:08.150524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-56bdb187-82da-463e-a4d0-28a394b714a0 None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:08.155076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-56bdb187-82da-463e-a4d0-28a394b714a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:08.158813 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f88d22-faa9-4875-97d2-7443fe17b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:08.159926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f88d22-faa9-4875-97d2-7443fe17b39a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:08.160366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f88d22-faa9-4875-97d2-7443fe17b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:08.160888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f88d22-faa9-4875-97d2-7443fe17b39a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:08.161881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f88d22-faa9-4875-97d2-7443fe17b39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:08.163701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f88d22-faa9-4875-97d2-7443fe17b39a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:08.181820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 961/1924] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:08.188542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f88d22-faa9-4875-97d2-7443fe17b39a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:08.197887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-63f88d22-faa9-4875-97d2-7443fe17b39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:08.229892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f88d22-faa9-4875-97d2-7443fe17b39a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:08.245024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6c1a5-70fe-487e-a51d-1098c764227e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:08.246827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6c1a5-70fe-487e-a51d-1098c764227e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:08.248470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6c1a5-70fe-487e-a51d-1098c764227e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:08.249493 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6c1a5-70fe-487e-a51d-1098c764227e admin admin] PATH_INFO: `/v3/projects/6ed5645dc5e4469381d9c34843bf4a3c/users/8be2c5e5fd5848acac2015e6f485e06b/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:08.293271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6c1a5-70fe-487e-a51d-1098c764227e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed5645dc5e4469381d9c34843bf4a3c, user_id=8be2c5e5fd5848acac2015e6f485e06b, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:08.299151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6c1a5-70fe-487e-a51d-1098c764227e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:08.330167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 964/1926] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:08.335820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 962/1926] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:08 2022] PUT /identity/v3/projects/6ed5645dc5e4469381d9c34843bf4a3c/users/8be2c5e5fd5848acac2015e6f485e06b/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:08.341304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0f331-d22b-4ac2-a63e-9db6b74cd2b5 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:08.341610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0f331-d22b-4ac2-a63e-9db6b74cd2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:08.341982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0f331-d22b-4ac2-a63e-9db6b74cd2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:08.373932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-47c0f331-d22b-4ac2-a63e-9db6b74cd2b5 None None] MFA Rules not processed for user `8be2c5e5fd5848acac2015e6f485e06b`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:08.375240 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-47c0f331-d22b-4ac2-a63e-9db6b74cd2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:08.473632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:08.478868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 965/1927] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:08.493086 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6c1a5-70fe-487e-a51d-1098c764227e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:08.495094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-44d6c1a5-70fe-487e-a51d-1098c764227e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:08.504638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0f331-d22b-4ac2-a63e-9db6b74cd2b5 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:08.506207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-47c0f331-d22b-4ac2-a63e-9db6b74cd2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:08.576907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6c1a5-70fe-487e-a51d-1098c764227e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:08.586916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427c497-f6f2-4570-ba65-4d0e110a377a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:08.589430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427c497-f6f2-4570-ba65-4d0e110a377a service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:08.589906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427c497-f6f2-4570-ba65-4d0e110a377a service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:08.590789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427c497-f6f2-4570-ba65-4d0e110a377a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:08.596105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0f331-d22b-4ac2-a63e-9db6b74cd2b5 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:08.602466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b98d5-e296-4bb3-b261-c205ba2d99a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:08.603611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b98d5-e296-4bb3-b261-c205ba2d99a6 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:08.603611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b98d5-e296-4bb3-b261-c205ba2d99a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:08.603780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b98d5-e296-4bb3-b261-c205ba2d99a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:08.614382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b98d5-e296-4bb3-b261-c205ba2d99a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:08.616107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b98d5-e296-4bb3-b261-c205ba2d99a6 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:08.634380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427c497-f6f2-4570-ba65-4d0e110a377a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:08.640195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 966/1928] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:08.643097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427c497-f6f2-4570-ba65-4d0e110a377a service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:08.657165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:08.661916 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b98d5-e296-4bb3-b261-c205ba2d99a6 service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:08.663604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ab2b98d5-e296-4bb3-b261-c205ba2d99a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:08.684198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 963/1929] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:08.686896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427c497-f6f2-4570-ba65-4d0e110a377a service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:08.692388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b427c497-f6f2-4570-ba65-4d0e110a377a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:08.760050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b98d5-e296-4bb3-b261-c205ba2d99a6 service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:08.765998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:08.766648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:08.766930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:08.767204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] PATH_INFO: `/v3/projects/57ad1932c4fe42d58ca9305fda2415b7` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:08.768488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ad1932c4fe42d58ca9305fda2415b7)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:08.770574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:08.842082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ad1932c4fe42d58ca9305fda2415b7', 'request_id': 'req-87cb7ff4-f22c-401f-a6d3-723586029721'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:08.856513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ad1932c4fe42d58ca9305fda2415b7', 'request_id': 'req-87cb7ff4-f22c-401f-a6d3-723586029721'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:08.865898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ad1932c4fe42d58ca9305fda2415b7', 'request_id': 'req-87cb7ff4-f22c-401f-a6d3-723586029721'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:08.868549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427c497-f6f2-4570-ba65-4d0e110a377a service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:08.882898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] The token cache is being invalidate because project 57ad1932c4fe42d58ca9305fda2415b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:08.883375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:08.884540 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87cb7ff4-f22c-401f-a6d3-723586029721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:08.890841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 967/1930] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:08 2022] DELETE /identity/v3/projects/57ad1932c4fe42d58ca9305fda2415b7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:08.893080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e260-4d94-44ec-81cc-0fc048cdfc31 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:08.893491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e260-4d94-44ec-81cc-0fc048cdfc31 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:08.894203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e260-4d94-44ec-81cc-0fc048cdfc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:08.921106 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5de1e260-4d94-44ec-81cc-0fc048cdfc31 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:08.922573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5de1e260-4d94-44ec-81cc-0fc048cdfc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:08.946962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:09.037512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.038517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.039373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.039678 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] PATH_INFO: `/v3/projects/9a0cab3c1c434f89ac64374ff7265d4a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.042094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0cab3c1c434f89ac64374ff7265d4a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.044399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.092668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 968/1931] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:09.094476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5ccd-c310-411c-8f41-4900640011b1 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.094763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5ccd-c310-411c-8f41-4900640011b1 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.095040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5ccd-c310-411c-8f41-4900640011b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.143283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-9a8f5ccd-c310-411c-8f41-4900640011b1 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:09.144596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9a8f5ccd-c310-411c-8f41-4900640011b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:09.169799 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0cab3c1c434f89ac64374ff7265d4a', 'request_id': 'req-c4989c88-15f6-4176-b50f-b4fd317c30e2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:09.201510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0cab3c1c434f89ac64374ff7265d4a', 'request_id': 'req-c4989c88-15f6-4176-b50f-b4fd317c30e2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:09.211222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0cab3c1c434f89ac64374ff7265d4a', 'request_id': 'req-c4989c88-15f6-4176-b50f-b4fd317c30e2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:09.227949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] The token cache is being invalidate because project 9a0cab3c1c434f89ac64374ff7265d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:09.228265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:09.229089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4989c88-15f6-4176-b50f-b4fd317c30e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:09.236353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 964/1932] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:08 2022] DELETE /identity/v3/projects/9a0cab3c1c434f89ac64374ff7265d4a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:09.238625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efd78c-5ca6-462f-93bc-956db561a94d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.239004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efd78c-5ca6-462f-93bc-956db561a94d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.239309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efd78c-5ca6-462f-93bc-956db561a94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.274248 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-32efd78c-5ca6-462f-93bc-956db561a94d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:09.275529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-32efd78c-5ca6-462f-93bc-956db561a94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:09.298093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 969/1933] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:09.302048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f5ccd-c310-411c-8f41-4900640011b1 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.318281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f5ccd-c310-411c-8f41-4900640011b1 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.332358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f5929-529e-4855-9e6d-878d0f565e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.333328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5929-529e-4855-9e6d-878d0f565e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.333741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5929-529e-4855-9e6d-878d0f565e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.334130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5929-529e-4855-9e6d-878d0f565e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.335066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f5929-529e-4855-9e6d-878d0f565e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:09.335520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f5929-529e-4855-9e6d-878d0f565e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.338516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f5929-529e-4855-9e6d-878d0f565e03 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.349288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:09.384015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 970/1934] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:09.385116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f5929-529e-4855-9e6d-878d0f565e03 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.413363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f5929-529e-4855-9e6d-878d0f565e03 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.428157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7170a0-2e8f-4efd-9bd9-13e6a6ada3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.428859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7170a0-2e8f-4efd-9bd9-13e6a6ada3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.429270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7170a0-2e8f-4efd-9bd9-13e6a6ada3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.429450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7170a0-2e8f-4efd-9bd9-13e6a6ada3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.430095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7170a0-2e8f-4efd-9bd9-13e6a6ada3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.434624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 965/1935] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:09.435925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7170a0-2e8f-4efd-9bd9-13e6a6ada3a2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.443473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa852a7a-b73e-44a5-8d3d-8e3005595d60 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.443763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa852a7a-b73e-44a5-8d3d-8e3005595d60 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.444069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa852a7a-b73e-44a5-8d3d-8e3005595d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.505423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aa852a7a-b73e-44a5-8d3d-8e3005595d60 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:09.506999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aa852a7a-b73e-44a5-8d3d-8e3005595d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:09.527878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 966/1936] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:09.529007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa852a7a-b73e-44a5-8d3d-8e3005595d60 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.532882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 971/1937] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:09 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:09.533845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7170a0-2e8f-4efd-9bd9-13e6a6ada3a2 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.546623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa852a7a-b73e-44a5-8d3d-8e3005595d60 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.638017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06ddab-0294-4d8c-84fb-74ddd692976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.638852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06ddab-0294-4d8c-84fb-74ddd692976f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.639221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06ddab-0294-4d8c-84fb-74ddd692976f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.639759 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06ddab-0294-4d8c-84fb-74ddd692976f admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.640903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06ddab-0294-4d8c-84fb-74ddd692976f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:09.641282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06ddab-0294-4d8c-84fb-74ddd692976f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.643686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06ddab-0294-4d8c-84fb-74ddd692976f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.645859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7170a0-2e8f-4efd-9bd9-13e6a6ada3a2 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.652723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd666454-3552-4cc7-8ce1-60064e1a1bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.653460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd666454-3552-4cc7-8ce1-60064e1a1bcc admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.653832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd666454-3552-4cc7-8ce1-60064e1a1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.654225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd666454-3552-4cc7-8ce1-60064e1a1bcc admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.656223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd666454-3552-4cc7-8ce1-60064e1a1bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.657449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd666454-3552-4cc7-8ce1-60064e1a1bcc admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.659446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 967/1938] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:09.664476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06ddab-0294-4d8c-84fb-74ddd692976f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.688802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06ddab-0294-4d8c-84fb-74ddd692976f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.700889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfff5d7-b88f-4088-bfcc-3dbb4bdd523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.702206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff5d7-b88f-4088-bfcc-3dbb4bdd523e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.702656 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 972/1939] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:09 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:09.703676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff5d7-b88f-4088-bfcc-3dbb4bdd523e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.704161 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff5d7-b88f-4088-bfcc-3dbb4bdd523e admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.705263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfff5d7-b88f-4088-bfcc-3dbb4bdd523e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.708421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd666454-3552-4cc7-8ce1-60064e1a1bcc admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.708980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfff5d7-b88f-4088-bfcc-3dbb4bdd523e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.726581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd666454-3552-4cc7-8ce1-60064e1a1bcc admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.734257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91d0b5-1302-4eee-9760-77002d6bcb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.734637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d0b5-1302-4eee-9760-77002d6bcb20 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.735009 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d0b5-1302-4eee-9760-77002d6bcb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.735492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d0b5-1302-4eee-9760-77002d6bcb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.736443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91d0b5-1302-4eee-9760-77002d6bcb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.737941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91d0b5-1302-4eee-9760-77002d6bcb20 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.744112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:09.750033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 973/1940] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:09.762691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91d0b5-1302-4eee-9760-77002d6bcb20 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.767735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 968/1941] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:09 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:09.769273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfff5d7-b88f-4088-bfcc-3dbb4bdd523e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.779476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91d0b5-1302-4eee-9760-77002d6bcb20 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.840462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfff5d7-b88f-4088-bfcc-3dbb4bdd523e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.845703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f018b-144a-44e5-b813-9885bfea6d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.846512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f018b-144a-44e5-b813-9885bfea6d45 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.846814 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f018b-144a-44e5-b813-9885bfea6d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.847070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f018b-144a-44e5-b813-9885bfea6d45 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.847735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f018b-144a-44e5-b813-9885bfea6d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.849177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a12d11-588e-43ce-8d56-c15eede4657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.849670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f018b-144a-44e5-b813-9885bfea6d45 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.849911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a12d11-588e-43ce-8d56-c15eede4657b admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.850154 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a12d11-588e-43ce-8d56-c15eede4657b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.850537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a12d11-588e-43ce-8d56-c15eede4657b admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.851220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a12d11-588e-43ce-8d56-c15eede4657b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.853239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a12d11-588e-43ce-8d56-c15eede4657b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.867338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 974/1942] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:09.876400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a12d11-588e-43ce-8d56-c15eede4657b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.877042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 969/1943] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:09 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:09.880828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f018b-144a-44e5-b813-9885bfea6d45 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.890378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a12d11-588e-43ce-8d56-c15eede4657b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.891825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f018b-144a-44e5-b813-9885bfea6d45 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.896654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8a490-7fbf-4cb7-8043-7627454c48fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.897238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8a490-7fbf-4cb7-8043-7627454c48fc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.897407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a65d5-d6a0-4454-bc94-1b5532021419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.897555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8a490-7fbf-4cb7-8043-7627454c48fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.897830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8a490-7fbf-4cb7-8043-7627454c48fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.898079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a65d5-d6a0-4454-bc94-1b5532021419 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.898365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a65d5-d6a0-4454-bc94-1b5532021419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.898458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8a490-7fbf-4cb7-8043-7627454c48fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.898638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a65d5-d6a0-4454-bc94-1b5532021419 admin admin] PATH_INFO: `/v3/projects/00b1686438d64275bcdaaaea02a5a825/users/140a45c086e04614932a24b328f46cf7/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.900111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8a490-7fbf-4cb7-8043-7627454c48fc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.915526 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 970/1944] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:09.916308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a65d5-d6a0-4454-bc94-1b5532021419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b1686438d64275bcdaaaea02a5a825, user_id=140a45c086e04614932a24b328f46cf7, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:09.916603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8a490-7fbf-4cb7-8043-7627454c48fc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:09.919586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a65d5-d6a0-4454-bc94-1b5532021419 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:09.928114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8a490-7fbf-4cb7-8043-7627454c48fc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:09.937422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 975/1945] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:09 2022] PUT /identity/v3/projects/00b1686438d64275bcdaaaea02a5a825/users/140a45c086e04614932a24b328f46cf7/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:09.946539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3081d33-2b66-4325-9a9d-d9daf194beb2 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.946867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3081d33-2b66-4325-9a9d-d9daf194beb2 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.947125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3081d33-2b66-4325-9a9d-d9daf194beb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:09.948898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:09.975908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b3081d33-2b66-4325-9a9d-d9daf194beb2 None None] MFA Rules not processed for user `140a45c086e04614932a24b328f46cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:09.977462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b3081d33-2b66-4325-9a9d-d9daf194beb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:09.997761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af5dff-3758-46f8-ade7-97a62e93113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:09.998487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5dff-3758-46f8-ade7-97a62e93113a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:09.999110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5dff-3758-46f8-ade7-97a62e93113a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:09.999478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5dff-3758-46f8-ade7-97a62e93113a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.000202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af5dff-3758-46f8-ade7-97a62e93113a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.002110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af5dff-3758-46f8-ade7-97a62e93113a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.015818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 971/1946] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:10.020075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af5dff-3758-46f8-ade7-97a62e93113a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.032793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af5dff-3758-46f8-ade7-97a62e93113a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.038229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bcf76-04a4-4a16-b068-29f76d1b261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.038886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bcf76-04a4-4a16-b068-29f76d1b261f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.039166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bcf76-04a4-4a16-b068-29f76d1b261f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.039504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bcf76-04a4-4a16-b068-29f76d1b261f admin admin] PATH_INFO: `/v3/projects/ab171de4f7594c53a30b0b762cce651f/users/98b69dae8d4a4d4085c6257f63127988/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.050381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 976/1947] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:10.054697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3081d33-2b66-4325-9a9d-d9daf194beb2 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.069875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3081d33-2b66-4325-9a9d-d9daf194beb2 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.078051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bcf76-04a4-4a16-b068-29f76d1b261f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab171de4f7594c53a30b0b762cce651f, user_id=98b69dae8d4a4d4085c6257f63127988, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.080690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bcf76-04a4-4a16-b068-29f76d1b261f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.081625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8422fa-d169-4875-935a-a06efa8d1432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.082261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8422fa-d169-4875-935a-a06efa8d1432 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.082539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8422fa-d169-4875-935a-a06efa8d1432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.082855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8422fa-d169-4875-935a-a06efa8d1432 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.083926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8422fa-d169-4875-935a-a06efa8d1432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.086897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8422fa-d169-4875-935a-a06efa8d1432 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.100530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 972/1948] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:10 2022] PUT /identity/v3/projects/ab171de4f7594c53a30b0b762cce651f/users/98b69dae8d4a4d4085c6257f63127988/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:10.112691 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc8897-8009-481d-8a8a-10515354b325 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.112981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc8897-8009-481d-8a8a-10515354b325 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.113253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc8897-8009-481d-8a8a-10515354b325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.130508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 977/1949] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:10 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:10.131910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8422fa-d169-4875-935a-a06efa8d1432 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.159389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ddbc8897-8009-481d-8a8a-10515354b325 None None] MFA Rules not processed for user `98b69dae8d4a4d4085c6257f63127988`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:10.161299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ddbc8897-8009-481d-8a8a-10515354b325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:10.195688 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:10.231188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8422fa-d169-4875-935a-a06efa8d1432 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.237553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f15cba-d848-40cb-a310-a667aa037e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.238918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f15cba-d848-40cb-a310-a667aa037e3d admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.239429 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f15cba-d848-40cb-a310-a667aa037e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.239927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f15cba-d848-40cb-a310-a667aa037e3d admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.240993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f15cba-d848-40cb-a310-a667aa037e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.243130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f15cba-d848-40cb-a310-a667aa037e3d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.277061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 978/1950] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:10 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:10.278389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f15cba-d848-40cb-a310-a667aa037e3d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.306145 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 973/1951] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:10.307785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f15cba-d848-40cb-a310-a667aa037e3d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.320227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc8897-8009-481d-8a8a-10515354b325 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.323441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e1f02-3dc4-4b8f-abfb-db23ab110fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.324374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1f02-3dc4-4b8f-abfb-db23ab110fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.324657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1f02-3dc4-4b8f-abfb-db23ab110fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.324991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1f02-3dc4-4b8f-abfb-db23ab110fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.325657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e1f02-3dc4-4b8f-abfb-db23ab110fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.330331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e1f02-3dc4-4b8f-abfb-db23ab110fb5 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.336295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc8897-8009-481d-8a8a-10515354b325 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.342026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a8651-4971-40bb-a001-fd0cc1aa052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.343077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a8651-4971-40bb-a001-fd0cc1aa052a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.343492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a8651-4971-40bb-a001-fd0cc1aa052a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.343808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a8651-4971-40bb-a001-fd0cc1aa052a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.344481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a8651-4971-40bb-a001-fd0cc1aa052a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.346834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a8651-4971-40bb-a001-fd0cc1aa052a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.357802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 979/1952] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:10.366225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e1f02-3dc4-4b8f-abfb-db23ab110fb5 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.382716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e1f02-3dc4-4b8f-abfb-db23ab110fb5 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.394817 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac4dfe-4cf9-4203-845e-bee993b612b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.395584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac4dfe-4cf9-4203-845e-bee993b612b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.396367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac4dfe-4cf9-4203-845e-bee993b612b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.396367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac4dfe-4cf9-4203-845e-bee993b612b9 admin admin] PATH_INFO: `/v3/projects/6d1469fe854e4a6f971646e3c77ddbd3/users/df5796203f1e4357867fc1fff98aae34/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.405257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 974/1953] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:10 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:10.409608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a8651-4971-40bb-a001-fd0cc1aa052a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.415976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac4dfe-4cf9-4203-845e-bee993b612b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1469fe854e4a6f971646e3c77ddbd3, user_id=df5796203f1e4357867fc1fff98aae34, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.421137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac4dfe-4cf9-4203-845e-bee993b612b9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.457207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 980/1954] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:10 2022] PUT /identity/v3/projects/6d1469fe854e4a6f971646e3c77ddbd3/users/df5796203f1e4357867fc1fff98aae34/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:10.461010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac4dfe-4cf9-4203-845e-bee993b612b9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.505733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a8651-4971-40bb-a001-fd0cc1aa052a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.513453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:10.552426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac4dfe-4cf9-4203-845e-bee993b612b9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.560267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb7eee-4330-4be9-a2e1-173875ebd82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.561790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb7eee-4330-4be9-a2e1-173875ebd82d admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.562189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb7eee-4330-4be9-a2e1-173875ebd82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.562404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb7eee-4330-4be9-a2e1-173875ebd82d admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.563078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb7eee-4330-4be9-a2e1-173875ebd82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.564837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb7eee-4330-4be9-a2e1-173875ebd82d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.580257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 981/1955] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:10.581325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb7eee-4330-4be9-a2e1-173875ebd82d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.597912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb7eee-4330-4be9-a2e1-173875ebd82d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.602435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a9059-c11f-462d-a83e-e364806e3e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.603319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a9059-c11f-462d-a83e-e364806e3e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.603777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a9059-c11f-462d-a83e-e364806e3e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.604116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a9059-c11f-462d-a83e-e364806e3e7e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.604527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5980c-dd42-46a0-bfe8-6a6186fa17c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.604861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a9059-c11f-462d-a83e-e364806e3e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.605392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5980c-dd42-46a0-bfe8-6a6186fa17c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.605792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5980c-dd42-46a0-bfe8-6a6186fa17c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.606170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5980c-dd42-46a0-bfe8-6a6186fa17c7 admin admin] PATH_INFO: `/v3/projects/6d1469fe854e4a6f971646e3c77ddbd3/users/df5796203f1e4357867fc1fff98aae34/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.608947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5980c-dd42-46a0-bfe8-6a6186fa17c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1469fe854e4a6f971646e3c77ddbd3, user_id=df5796203f1e4357867fc1fff98aae34, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.609344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a9059-c11f-462d-a83e-e364806e3e7e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.612494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5980c-dd42-46a0-bfe8-6a6186fa17c7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.627207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 982/1956] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:10 2022] PUT /identity/v3/projects/6d1469fe854e4a6f971646e3c77ddbd3/users/df5796203f1e4357867fc1fff98aae34/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:10.640433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5588f6-d3dd-46c5-9e84-edf2cb417cf1 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.640832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5588f6-d3dd-46c5-9e84-edf2cb417cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.641310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5588f6-d3dd-46c5-9e84-edf2cb417cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.653993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 975/1957] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:10 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:10.655721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a9059-c11f-462d-a83e-e364806e3e7e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.667126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a9059-c11f-462d-a83e-e364806e3e7e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.698069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5c5588f6-d3dd-46c5-9e84-edf2cb417cf1 None None] MFA Rules not processed for user `df5796203f1e4357867fc1fff98aae34`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:10.702268 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5c5588f6-d3dd-46c5-9e84-edf2cb417cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:10.782467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fb2a8-c508-438d-856b-f339449afd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.783151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fb2a8-c508-438d-856b-f339449afd9b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.783461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fb2a8-c508-438d-856b-f339449afd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.783856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fb2a8-c508-438d-856b-f339449afd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.784510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fb2a8-c508-438d-856b-f339449afd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.793206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fb2a8-c508-438d-856b-f339449afd9b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.821276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 976/1958] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:10.825019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 983/1959] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:10.827034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5588f6-d3dd-46c5-9e84-edf2cb417cf1 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.839134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:10.849684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5588f6-d3dd-46c5-9e84-edf2cb417cf1 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.851366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fb2a8-c508-438d-856b-f339449afd9b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.854189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b02fb2a8-c508-438d-856b-f339449afd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:10.858593 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47583d76-4989-43ca-ba43-76b6184c2ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.859464 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47583d76-4989-43ca-ba43-76b6184c2ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.859816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47583d76-4989-43ca-ba43-76b6184c2ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.860171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47583d76-4989-43ca-ba43-76b6184c2ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.860899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47583d76-4989-43ca-ba43-76b6184c2ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.863526 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47583d76-4989-43ca-ba43-76b6184c2ea4 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.880475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 984/1960] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:10.884499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47583d76-4989-43ca-ba43-76b6184c2ea4 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:10.909976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47583d76-4989-43ca-ba43-76b6184c2ea4 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.920982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7eb82-d905-47ed-804f-39ac488eed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.923671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7eb82-d905-47ed-804f-39ac488eed82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.924181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7eb82-d905-47ed-804f-39ac488eed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.924723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7eb82-d905-47ed-804f-39ac488eed82 admin admin] PATH_INFO: `/v3/projects/d9466a743b9849e6b90de9349d6caef4/users/428f9ddb0ec241b18dd000fb5fc2fb12/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.943875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7eb82-d905-47ed-804f-39ac488eed82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9466a743b9849e6b90de9349d6caef4, user_id=428f9ddb0ec241b18dd000fb5fc2fb12, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:10.947168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7eb82-d905-47ed-804f-39ac488eed82 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:10.955177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fb2a8-c508-438d-856b-f339449afd9b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:10.960974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448242d3-8e69-4e37-b82e-a4988d144dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:10.961747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448242d3-8e69-4e37-b82e-a4988d144dfc service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.962028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448242d3-8e69-4e37-b82e-a4988d144dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.962300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448242d3-8e69-4e37-b82e-a4988d144dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:10.975156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 985/1961] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:10 2022] PUT /identity/v3/projects/d9466a743b9849e6b90de9349d6caef4/users/428f9ddb0ec241b18dd000fb5fc2fb12/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:10.988380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e152-8ee0-4846-a62c-bac52b042a74 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:10.988776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e152-8ee0-4846-a62c-bac52b042a74 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:10.988945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e152-8ee0-4846-a62c-bac52b042a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:11.021332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2a51e152-8ee0-4846-a62c-bac52b042a74 None None] MFA Rules not processed for user `428f9ddb0ec241b18dd000fb5fc2fb12`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:11.022867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2a51e152-8ee0-4846-a62c-bac52b042a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:11.039357 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:11.053305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448242d3-8e69-4e37-b82e-a4988d144dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:11.054740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448242d3-8e69-4e37-b82e-a4988d144dfc service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:11.065093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 977/1962] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:11.133496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 986/1963] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:11.138289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448242d3-8e69-4e37-b82e-a4988d144dfc service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:11.150321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448242d3-8e69-4e37-b82e-a4988d144dfc service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:11.235561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002bd9d-602b-4e8e-8cbb-0791a680b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:11.236173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002bd9d-602b-4e8e-8cbb-0791a680b3da admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:11.236441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002bd9d-602b-4e8e-8cbb-0791a680b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:11.236705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002bd9d-602b-4e8e-8cbb-0791a680b3da admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:11.237344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002bd9d-602b-4e8e-8cbb-0791a680b3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:11.239239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002bd9d-602b-4e8e-8cbb-0791a680b3da admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:11.268361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 978/1964] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:11 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:11.272524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51e152-8ee0-4846-a62c-bac52b042a74 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:11.286315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51e152-8ee0-4846-a62c-bac52b042a74 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:11.377506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0788c01-5ed8-406e-8562-15610a939bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:11.378271 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0788c01-5ed8-406e-8562-15610a939bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:11.378578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0788c01-5ed8-406e-8562-15610a939bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:11.379639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0788c01-5ed8-406e-8562-15610a939bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:11.381457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0788c01-5ed8-406e-8562-15610a939bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:11.383526 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0788c01-5ed8-406e-8562-15610a939bb3 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:11.449777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 987/1965] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:11 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:11.456689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002bd9d-602b-4e8e-8cbb-0791a680b3da admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:11.469603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0788c01-5ed8-406e-8562-15610a939bb3 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:11.473466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f0788c01-5ed8-406e-8562-15610a939bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:11.491348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002bd9d-602b-4e8e-8cbb-0791a680b3da admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:11.506156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0788c01-5ed8-406e-8562-15610a939bb3 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:11.507045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6feb77-8522-4124-b6d7-67f5417b1fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:11.510163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6feb77-8522-4124-b6d7-67f5417b1fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:11.510783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6feb77-8522-4124-b6d7-67f5417b1fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:11.512189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6feb77-8522-4124-b6d7-67f5417b1fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:11.513762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6feb77-8522-4124-b6d7-67f5417b1fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:11.528764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6feb77-8522-4124-b6d7-67f5417b1fdb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:11.533288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:11.534494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:11.537007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:11.540179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] PATH_INFO: `/v3/users/b3474a511bc242669f8b92a5c6cb0aa9` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:11.545966 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3474a511bc242669f8b92a5c6cb0aa9)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:11.553300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:11.569536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 979/1966] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:11.570377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6feb77-8522-4124-b6d7-67f5417b1fdb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:11.594958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6feb77-8522-4124-b6d7-67f5417b1fdb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:11.608611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2995ed1-2163-457e-bf86-87e9e6b4ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:11.609306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995ed1-2163-457e-bf86-87e9e6b4ce61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:11.609586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995ed1-2163-457e-bf86-87e9e6b4ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:11.609864 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995ed1-2163-457e-bf86-87e9e6b4ce61 admin admin] PATH_INFO: `/v3/projects/2a272b25c6ba46f4a75789ce9ba4a738/users/313e5e568e364b74abcf6c4a73d94eec/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:11.652866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:11.658654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2995ed1-2163-457e-bf86-87e9e6b4ce61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a272b25c6ba46f4a75789ce9ba4a738, user_id=313e5e568e364b74abcf6c4a73d94eec, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:11.669948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2995ed1-2163-457e-bf86-87e9e6b4ce61 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:11.670704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3474a511bc242669f8b92a5c6cb0aa9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:11.705763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 980/1967] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:11 2022] PUT /identity/v3/projects/2a272b25c6ba46f4a75789ce9ba4a738/users/313e5e568e364b74abcf6c4a73d94eec/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:11.707707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3474a511bc242669f8b92a5c6cb0aa9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:11.711280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2995ed1-2163-457e-bf86-87e9e6b4ce61 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:11.731792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3474a511bc242669f8b92a5c6cb0aa9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:11.733050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3474a511bc242669f8b92a5c6cb0aa9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:11.735472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3728884-baed-4845-a048-8fcacaf2bdb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3474a511bc242669f8b92a5c6cb0aa9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:11.767035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 988/1968] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:11 2022] DELETE /identity/v3/users/b3474a511bc242669f8b92a5c6cb0aa9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:11.772814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace43a1-3a24-4970-bbb3-d48335eb12e3 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:11.773196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace43a1-3a24-4970-bbb3-d48335eb12e3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:11.773565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace43a1-3a24-4970-bbb3-d48335eb12e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:11.832493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2ace43a1-3a24-4970-bbb3-d48335eb12e3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:11.835486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2ace43a1-3a24-4970-bbb3-d48335eb12e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:11.888677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2995ed1-2163-457e-bf86-87e9e6b4ce61 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:11.952138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:11.974359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 989/1969] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:11.986667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d812d7-1a4d-4062-bd3b-54907e58cded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:11.987328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d812d7-1a4d-4062-bd3b-54907e58cded admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:11.987637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d812d7-1a4d-4062-bd3b-54907e58cded admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:11.988644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d812d7-1a4d-4062-bd3b-54907e58cded admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:11.989446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d812d7-1a4d-4062-bd3b-54907e58cded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:11.991353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d812d7-1a4d-4062-bd3b-54907e58cded admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:12.003756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace43a1-3a24-4970-bbb3-d48335eb12e3 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:12.005696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2ace43a1-3a24-4970-bbb3-d48335eb12e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:12.011351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 981/1970] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:12.016186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d812d7-1a4d-4062-bd3b-54907e58cded admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:12.020157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-62d812d7-1a4d-4062-bd3b-54907e58cded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:12.045544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d812d7-1a4d-4062-bd3b-54907e58cded admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:12.070196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3be138-19ac-4b40-be26-6315f2dfccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:12.073558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3be138-19ac-4b40-be26-6315f2dfccfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:12.074380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3be138-19ac-4b40-be26-6315f2dfccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:12.076060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3be138-19ac-4b40-be26-6315f2dfccfd admin admin] PATH_INFO: `/v3/projects/2a272b25c6ba46f4a75789ce9ba4a738/users/313e5e568e364b74abcf6c4a73d94eec/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:12.079153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3be138-19ac-4b40-be26-6315f2dfccfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a272b25c6ba46f4a75789ce9ba4a738, user_id=313e5e568e364b74abcf6c4a73d94eec, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:12.081856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3be138-19ac-4b40-be26-6315f2dfccfd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:12.107034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 982/1971] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:12 2022] PUT /identity/v3/projects/2a272b25c6ba46f4a75789ce9ba4a738/users/313e5e568e364b74abcf6c4a73d94eec/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:12.109184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87022-a083-43bb-a3a4-c1a75202f931 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:12.109660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87022-a083-43bb-a3a4-c1a75202f931 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:12.109885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87022-a083-43bb-a3a4-c1a75202f931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:12.148604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace43a1-3a24-4970-bbb3-d48335eb12e3 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:12.152648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2cf87022-a083-43bb-a3a4-c1a75202f931 None None] MFA Rules not processed for user `313e5e568e364b74abcf6c4a73d94eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:12.154185 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2cf87022-a083-43bb-a3a4-c1a75202f931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:12.232577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfb5d8-e356-4494-aab9-dc8390de7404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:12.234043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfb5d8-e356-4494-aab9-dc8390de7404 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:12.235007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfb5d8-e356-4494-aab9-dc8390de7404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:12.235482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfb5d8-e356-4494-aab9-dc8390de7404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:12.266153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 983/1972] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:12.280804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87022-a083-43bb-a3a4-c1a75202f931 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:12.282513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2cf87022-a083-43bb-a3a4-c1a75202f931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:12.285840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:12.325003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfb5d8-e356-4494-aab9-dc8390de7404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:12.326461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfb5d8-e356-4494-aab9-dc8390de7404 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:12.337240 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 990/1973] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:12.358666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87022-a083-43bb-a3a4-c1a75202f931 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:12.363873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7b949-3a20-4ddb-a7fe-9afca3bc0be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:12.364588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b949-3a20-4ddb-a7fe-9afca3bc0be8 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:12.364862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b949-3a20-4ddb-a7fe-9afca3bc0be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:12.365130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b949-3a20-4ddb-a7fe-9afca3bc0be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:12.376316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7b949-3a20-4ddb-a7fe-9afca3bc0be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:12.378050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7b949-3a20-4ddb-a7fe-9afca3bc0be8 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:12.391069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 984/1974] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:12.440349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfb5d8-e356-4494-aab9-dc8390de7404 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:12.441801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8bdfb5d8-e356-4494-aab9-dc8390de7404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:12.454489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfb5d8-e356-4494-aab9-dc8390de7404 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:12.458218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ad63a-d7b4-4c9b-a531-591a9c33ce7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:12.458931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ad63a-d7b4-4c9b-a531-591a9c33ce7c service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:12.459127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ad63a-d7b4-4c9b-a531-591a9c33ce7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:12.459480 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ad63a-d7b4-4c9b-a531-591a9c33ce7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:12.461561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8d0ad63a-d7b4-4c9b-a531-591a9c33ce7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:12.565660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7b949-3a20-4ddb-a7fe-9afca3bc0be8 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:12.577018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7b949-3a20-4ddb-a7fe-9afca3bc0be8 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:12.581442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ad63a-d7b4-4c9b-a531-591a9c33ce7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:12.581979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167041d-1adc-4059-b814-22b85ebabab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:12.582730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167041d-1adc-4059-b814-22b85ebabab4 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:12.582901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ad63a-d7b4-4c9b-a531-591a9c33ce7c service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:12.583014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167041d-1adc-4059-b814-22b85ebabab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:12.583321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167041d-1adc-4059-b814-22b85ebabab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:12.585096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0167041d-1adc-4059-b814-22b85ebabab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:12.599965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 991/1975] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:12.684653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ad63a-d7b4-4c9b-a531-591a9c33ce7c service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:12.684957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:12.686464 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8d0ad63a-d7b4-4c9b-a531-591a9c33ce7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:12.705260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167041d-1adc-4059-b814-22b85ebabab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:12.708363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167041d-1adc-4059-b814-22b85ebabab4 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:12.710999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ad63a-d7b4-4c9b-a531-591a9c33ce7c service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:12.716826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:12.717484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:12.717761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:12.718033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] PATH_INFO: `/v3/projects/f81831b7b5194a2cbe545cd122e4be3e` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:12.719449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81831b7b5194a2cbe545cd122e4be3e)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:12.721647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:12.734883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 985/1976] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:12.785348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81831b7b5194a2cbe545cd122e4be3e', 'request_id': 'req-30066e7b-2e7b-4095-8694-422c2e7ffc25'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:12.796671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81831b7b5194a2cbe545cd122e4be3e', 'request_id': 'req-30066e7b-2e7b-4095-8694-422c2e7ffc25'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:12.812241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81831b7b5194a2cbe545cd122e4be3e', 'request_id': 'req-30066e7b-2e7b-4095-8694-422c2e7ffc25'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:12.829420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] The token cache is being invalidate because project f81831b7b5194a2cbe545cd122e4be3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:12.829719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:12.831752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-30066e7b-2e7b-4095-8694-422c2e7ffc25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:12.833944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 992/1977] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:12 2022] DELETE /identity/v3/projects/f81831b7b5194a2cbe545cd122e4be3e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:12.839994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bffc8-fd62-451b-8c73-db2938b1593d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:12.840291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bffc8-fd62-451b-8c73-db2938b1593d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:12.840622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bffc8-fd62-451b-8c73-db2938b1593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:12.877602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c63bffc8-fd62-451b-8c73-db2938b1593d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:12.881802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c63bffc8-fd62-451b-8c73-db2938b1593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:12.972034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 986/1978] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:12.980258 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b8bad-04e9-4747-b514-9e7de0cbe611 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:12.980780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b8bad-04e9-4747-b514-9e7de0cbe611 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:12.980780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b8bad-04e9-4747-b514-9e7de0cbe611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.009749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5a8b8bad-04e9-4747-b514-9e7de0cbe611 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:13.011085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5a8b8bad-04e9-4747-b514-9e7de0cbe611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:13.020374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 993/1979] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:13.025226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bffc8-fd62-451b-8c73-db2938b1593d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:13.037458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bffc8-fd62-451b-8c73-db2938b1593d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:13.058391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1697b75-2aa2-4e7e-a42c-6e3de01706cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:13.058858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1697b75-2aa2-4e7e-a42c-6e3de01706cd admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:13.059139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1697b75-2aa2-4e7e-a42c-6e3de01706cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:13.059441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1697b75-2aa2-4e7e-a42c-6e3de01706cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.060101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1697b75-2aa2-4e7e-a42c-6e3de01706cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:13.060400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1697b75-2aa2-4e7e-a42c-6e3de01706cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:13.062430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1697b75-2aa2-4e7e-a42c-6e3de01706cd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:13.076618 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 987/1980] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:13.080971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b8bad-04e9-4747-b514-9e7de0cbe611 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:13.091032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b8bad-04e9-4747-b514-9e7de0cbe611 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:13.096462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e00619-64c6-47c9-99ec-2c939d6323e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:13.097245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e00619-64c6-47c9-99ec-2c939d6323e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:13.097651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e00619-64c6-47c9-99ec-2c939d6323e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:13.098024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e00619-64c6-47c9-99ec-2c939d6323e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.098818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e00619-64c6-47c9-99ec-2c939d6323e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:13.101247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e00619-64c6-47c9-99ec-2c939d6323e1 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:13.157141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 994/1981] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:13 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:13.172636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1697b75-2aa2-4e7e-a42c-6e3de01706cd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:13.185702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1697b75-2aa2-4e7e-a42c-6e3de01706cd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:13.296146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c543f6-0a09-4293-bb12-bc34bcf8f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:13.297033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c543f6-0a09-4293-bb12-bc34bcf8f9fd admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:13.297320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c543f6-0a09-4293-bb12-bc34bcf8f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:13.297594 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c543f6-0a09-4293-bb12-bc34bcf8f9fd admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.298242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c543f6-0a09-4293-bb12-bc34bcf8f9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:13.300414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c543f6-0a09-4293-bb12-bc34bcf8f9fd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:13.350873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 988/1982] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:13 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:13.355208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e00619-64c6-47c9-99ec-2c939d6323e1 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:13.371089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e00619-64c6-47c9-99ec-2c939d6323e1 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:13.395902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d480fef-4c2c-4698-b210-83b0d0826e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:13.397140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d480fef-4c2c-4698-b210-83b0d0826e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:13.397810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d480fef-4c2c-4698-b210-83b0d0826e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:13.398321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d480fef-4c2c-4698-b210-83b0d0826e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.400221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d480fef-4c2c-4698-b210-83b0d0826e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:13.403225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d480fef-4c2c-4698-b210-83b0d0826e43 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:13.425921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 995/1983] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:13.431711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c543f6-0a09-4293-bb12-bc34bcf8f9fd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:13.454044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c543f6-0a09-4293-bb12-bc34bcf8f9fd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:13.464340 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673383d-3e97-4971-a9e2-6c0e608971c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:13.465180 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673383d-3e97-4971-a9e2-6c0e608971c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:13.465611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673383d-3e97-4971-a9e2-6c0e608971c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:13.466005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673383d-3e97-4971-a9e2-6c0e608971c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.466750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673383d-3e97-4971-a9e2-6c0e608971c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:13.469775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673383d-3e97-4971-a9e2-6c0e608971c8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:13.488928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 989/1984] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:13.493557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d480fef-4c2c-4698-b210-83b0d0826e43 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:13.516791 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d480fef-4c2c-4698-b210-83b0d0826e43 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:13.522123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925c8f9-7830-4703-a26b-1e89526a7d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:13.523034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925c8f9-7830-4703-a26b-1e89526a7d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:13.523212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925c8f9-7830-4703-a26b-1e89526a7d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:13.523482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925c8f9-7830-4703-a26b-1e89526a7d1c admin admin] PATH_INFO: `/v3/projects/2d358311d7124bca8e83a905d20215e6/users/53b7032bd152427f94f11f03077d87d3/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.527461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:13.541279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925c8f9-7830-4703-a26b-1e89526a7d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d358311d7124bca8e83a905d20215e6, user_id=53b7032bd152427f94f11f03077d87d3, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:13.545180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925c8f9-7830-4703-a26b-1e89526a7d1c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:13.562579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 996/1985] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:13 2022] PUT /identity/v3/projects/2d358311d7124bca8e83a905d20215e6/users/53b7032bd152427f94f11f03077d87d3/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:13.574405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6203c-7fb4-4477-bd98-33f0adfd5995 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:13.574980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6203c-7fb4-4477-bd98-33f0adfd5995 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:13.574980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6203c-7fb4-4477-bd98-33f0adfd5995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.609999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-47a6203c-7fb4-4477-bd98-33f0adfd5995 None None] MFA Rules not processed for user `53b7032bd152427f94f11f03077d87d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:13.611363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-47a6203c-7fb4-4477-bd98-33f0adfd5995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:13.665320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:13.690974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 990/1986] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:13.696380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925c8f9-7830-4703-a26b-1e89526a7d1c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:13.771209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925c8f9-7830-4703-a26b-1e89526a7d1c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:13.782999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2af43c-f939-483d-9d6e-eaa3a91d990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:13.784715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af43c-f939-483d-9d6e-eaa3a91d990a admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:13.784715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af43c-f939-483d-9d6e-eaa3a91d990a admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:13.784715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af43c-f939-483d-9d6e-eaa3a91d990a admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.785013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2af43c-f939-483d-9d6e-eaa3a91d990a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:13.789641 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2af43c-f939-483d-9d6e-eaa3a91d990a admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:13.820256 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 997/1987] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:13 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:13.825278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6203c-7fb4-4477-bd98-33f0adfd5995 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:13.837648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6203c-7fb4-4477-bd98-33f0adfd5995 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:13.899786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb1f6c-f7c3-4edc-8cac-2174f1ae01de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:13.900671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb1f6c-f7c3-4edc-8cac-2174f1ae01de admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:13.901383 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb1f6c-f7c3-4edc-8cac-2174f1ae01de admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:13.901799 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb1f6c-f7c3-4edc-8cac-2174f1ae01de admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.902631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb1f6c-f7c3-4edc-8cac-2174f1ae01de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:13.905286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb1f6c-f7c3-4edc-8cac-2174f1ae01de admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:13.936994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 991/1988] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:13 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:13.939375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2af43c-f939-483d-9d6e-eaa3a91d990a admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:13.954046 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2af43c-f939-483d-9d6e-eaa3a91d990a admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:13.976685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47805b87-e38b-4b0c-a731-6297b0ad14d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:13.979437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805b87-e38b-4b0c-a731-6297b0ad14d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:13.980162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805b87-e38b-4b0c-a731-6297b0ad14d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:13.984461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805b87-e38b-4b0c-a731-6297b0ad14d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:13.986093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47805b87-e38b-4b0c-a731-6297b0ad14d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:13.988318 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47805b87-e38b-4b0c-a731-6297b0ad14d7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:14.006039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 998/1989] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:14.007958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb1f6c-f7c3-4edc-8cac-2174f1ae01de admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:14.024195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb1f6c-f7c3-4edc-8cac-2174f1ae01de admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:14.032190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6cd29-c087-441f-8fa2-19577c3c8c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:14.033627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6cd29-c087-441f-8fa2-19577c3c8c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:14.034287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6cd29-c087-441f-8fa2-19577c3c8c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:14.034766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6cd29-c087-441f-8fa2-19577c3c8c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:14.035566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6cd29-c087-441f-8fa2-19577c3c8c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:14.038772 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6cd29-c087-441f-8fa2-19577c3c8c36 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:14.056215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 992/1990] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:14.061151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47805b87-e38b-4b0c-a731-6297b0ad14d7 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:14.073287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47805b87-e38b-4b0c-a731-6297b0ad14d7 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:14.079001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a51b4-26ce-465a-aca9-2c1fc900a9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:14.080013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a51b4-26ce-465a-aca9-2c1fc900a9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:14.080211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a51b4-26ce-465a-aca9-2c1fc900a9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:14.080643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a51b4-26ce-465a-aca9-2c1fc900a9a8 admin admin] PATH_INFO: `/v3/projects/25d9adc644ab4d369befbe032dce7450/users/e1b708b1d6b1434297ed3c2f56e004b5/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:14.098841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a51b4-26ce-465a-aca9-2c1fc900a9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d9adc644ab4d369befbe032dce7450, user_id=e1b708b1d6b1434297ed3c2f56e004b5, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:14.101771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a51b4-26ce-465a-aca9-2c1fc900a9a8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:14.123582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 999/1991] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:14 2022] PUT /identity/v3/projects/25d9adc644ab4d369befbe032dce7450/users/e1b708b1d6b1434297ed3c2f56e004b5/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:14.134422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1cb28-9df7-42f8-9ff5-ecd28f5dd2be None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:14.134750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1cb28-9df7-42f8-9ff5-ecd28f5dd2be None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:14.135049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1cb28-9df7-42f8-9ff5-ecd28f5dd2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:14.174785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-94f1cb28-9df7-42f8-9ff5-ecd28f5dd2be None None] MFA Rules not processed for user `e1b708b1d6b1434297ed3c2f56e004b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:14.177598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-94f1cb28-9df7-42f8-9ff5-ecd28f5dd2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:14.384004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 993/1992] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:14.386961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a51b4-26ce-465a-aca9-2c1fc900a9a8 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:14.468058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a51b4-26ce-465a-aca9-2c1fc900a9a8 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:14.476804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3e01-eae7-4b1d-970e-82d4d029ba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:14.478303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3e01-eae7-4b1d-970e-82d4d029ba86 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:14.478585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3e01-eae7-4b1d-970e-82d4d029ba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:14.479036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3e01-eae7-4b1d-970e-82d4d029ba86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:14.479907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3e01-eae7-4b1d-970e-82d4d029ba86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:14.483458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3e01-eae7-4b1d-970e-82d4d029ba86 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:14.555601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1cb28-9df7-42f8-9ff5-ecd28f5dd2be None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:14.570358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1000/1993] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:14 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:14.578046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1cb28-9df7-42f8-9ff5-ecd28f5dd2be None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:14.674350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:14.707073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f9e66-45f1-49e8-a7c6-592a0bfb83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:14.707984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f9e66-45f1-49e8-a7c6-592a0bfb83f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:14.708434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f9e66-45f1-49e8-a7c6-592a0bfb83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:14.708899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f9e66-45f1-49e8-a7c6-592a0bfb83f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:14.709743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f9e66-45f1-49e8-a7c6-592a0bfb83f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:14.712084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f9e66-45f1-49e8-a7c6-592a0bfb83f5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:14.776817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 994/1994] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:14 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:14.777161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3e01-eae7-4b1d-970e-82d4d029ba86 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:14.796008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3e01-eae7-4b1d-970e-82d4d029ba86 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:14.808888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e257fa-ee2c-48d1-a25a-0845b37368a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:14.809538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e257fa-ee2c-48d1-a25a-0845b37368a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:14.809820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e257fa-ee2c-48d1-a25a-0845b37368a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:14.810094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e257fa-ee2c-48d1-a25a-0845b37368a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:14.810753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e257fa-ee2c-48d1-a25a-0845b37368a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:14.812448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e257fa-ee2c-48d1-a25a-0845b37368a1 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:14.863840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1001/1995] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:14.869014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f9e66-45f1-49e8-a7c6-592a0bfb83f5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:14.888239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f9e66-45f1-49e8-a7c6-592a0bfb83f5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:14.900757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ab7ca-5f74-46a1-a1c3-7b88ff894fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:14.902183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab7ca-5f74-46a1-a1c3-7b88ff894fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:14.902669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab7ca-5f74-46a1-a1c3-7b88ff894fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:14.903138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab7ca-5f74-46a1-a1c3-7b88ff894fa1 admin admin] PATH_INFO: `/v3/projects/bb11dc11e0a04210abc5746c5526b496/users/2c31971d4e384b308f1bdf24c3eba57e/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:14.955857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ab7ca-5f74-46a1-a1c3-7b88ff894fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb11dc11e0a04210abc5746c5526b496, user_id=2c31971d4e384b308f1bdf24c3eba57e, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:14.964884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ab7ca-5f74-46a1-a1c3-7b88ff894fa1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:15.012031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 995/1996] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:14 2022] PUT /identity/v3/projects/bb11dc11e0a04210abc5746c5526b496/users/2c31971d4e384b308f1bdf24c3eba57e/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:15.016317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e257fa-ee2c-48d1-a25a-0845b37368a1 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:15.043578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e257fa-ee2c-48d1-a25a-0845b37368a1 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:15.055084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:15.200957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4833c52-7407-4c9b-9121-2adf446a42ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:15.202558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4833c52-7407-4c9b-9121-2adf446a42ba admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:15.202912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4833c52-7407-4c9b-9121-2adf446a42ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:15.203355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4833c52-7407-4c9b-9121-2adf446a42ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:15.204081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4833c52-7407-4c9b-9121-2adf446a42ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:15.207346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4833c52-7407-4c9b-9121-2adf446a42ba admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:15.232938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1002/1997] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:15.240062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ab7ca-5f74-46a1-a1c3-7b88ff894fa1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:15.254937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ab7ca-5f74-46a1-a1c3-7b88ff894fa1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:15.261545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98e221-4476-448f-8d90-eb03f3392cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:15.262364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98e221-4476-448f-8d90-eb03f3392cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:15.262709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98e221-4476-448f-8d90-eb03f3392cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:15.263152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98e221-4476-448f-8d90-eb03f3392cca admin admin] PATH_INFO: `/v3/projects/bb11dc11e0a04210abc5746c5526b496/users/2c31971d4e384b308f1bdf24c3eba57e/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:15.265555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98e221-4476-448f-8d90-eb03f3392cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb11dc11e0a04210abc5746c5526b496, user_id=2c31971d4e384b308f1bdf24c3eba57e, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:15.278595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98e221-4476-448f-8d90-eb03f3392cca admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:15.307641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 996/1998] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:15 2022] PUT /identity/v3/projects/bb11dc11e0a04210abc5746c5526b496/users/2c31971d4e384b308f1bdf24c3eba57e/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:15.316987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816783-4c94-4000-9250-a15735986e97 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:15.317289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816783-4c94-4000-9250-a15735986e97 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:15.317563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816783-4c94-4000-9250-a15735986e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:15.389465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6c816783-4c94-4000-9250-a15735986e97 None None] MFA Rules not processed for user `2c31971d4e384b308f1bdf24c3eba57e`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:15.390860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6c816783-4c94-4000-9250-a15735986e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:15.558695 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1003/1999] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:15.644093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98e221-4476-448f-8d90-eb03f3392cca admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:15.647452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3e98e221-4476-448f-8d90-eb03f3392cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:15.716317 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98e221-4476-448f-8d90-eb03f3392cca admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:15.722785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234f100-2e42-49ce-a92e-6f8360e71440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:15.723694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f100-2e42-49ce-a92e-6f8360e71440 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:15.724205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f100-2e42-49ce-a92e-6f8360e71440 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:15.724656 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f100-2e42-49ce-a92e-6f8360e71440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:15.726503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c816783-4c94-4000-9250-a15735986e97 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:15.729572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6c816783-4c94-4000-9250-a15735986e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:15.869739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234f100-2e42-49ce-a92e-6f8360e71440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:15.870572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c816783-4c94-4000-9250-a15735986e97 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:15.871740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234f100-2e42-49ce-a92e-6f8360e71440 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:15.881006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:15.881961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:15.883116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 997/2000] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:15.884378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:15.884890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] PATH_INFO: `/v3/users/2a0d532c925548058ece2d039a12fc06` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:15.890234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0d532c925548058ece2d039a12fc06)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:15.892212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:15.950395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:15.983841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0d532c925548058ece2d039a12fc06'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:15.998978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0d532c925548058ece2d039a12fc06'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:16.015196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0d532c925548058ece2d039a12fc06'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:16.016960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0d532c925548058ece2d039a12fc06'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:16.017657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0d532c925548058ece2d039a12fc06'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:16.041254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1004/2001] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:15 2022] DELETE /identity/v3/users/2a0d532c925548058ece2d039a12fc06 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:16.043387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508281b-68a9-4713-8f1a-55f369df7db2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:16.043744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508281b-68a9-4713-8f1a-55f369df7db2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:16.044096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508281b-68a9-4713-8f1a-55f369df7db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:16.067467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c508281b-68a9-4713-8f1a-55f369df7db2 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:16.069038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c508281b-68a9-4713-8f1a-55f369df7db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:16.146242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:16.161281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 998/2002] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:16.167315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:16.169809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:16.301295 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecf935-4e0a-4dc4-893c-0583e4ab0dd3 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:16.306503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3673163-2e92-4ff7-bf0c-ac2cbbf1b655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:16.307491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673163-2e92-4ff7-bf0c-ac2cbbf1b655 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:16.307953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673163-2e92-4ff7-bf0c-ac2cbbf1b655 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:16.308215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673163-2e92-4ff7-bf0c-ac2cbbf1b655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:16.334909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3673163-2e92-4ff7-bf0c-ac2cbbf1b655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:16.338004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3673163-2e92-4ff7-bf0c-ac2cbbf1b655 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:16.356809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1005/2003] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:16.764701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508281b-68a9-4713-8f1a-55f369df7db2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:16.768068 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c508281b-68a9-4713-8f1a-55f369df7db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:16.788724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508281b-68a9-4713-8f1a-55f369df7db2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:16.793952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:16.794667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:16.794949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:16.795223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] PATH_INFO: `/v3/projects/2253bf41281947cdb297cf8acbae184e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:16.796411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2253bf41281947cdb297cf8acbae184e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:16.800203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:16.896183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2253bf41281947cdb297cf8acbae184e', 'request_id': 'req-93e64cf0-1226-4003-9e6f-17f76fb66db6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:16.930917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2253bf41281947cdb297cf8acbae184e', 'request_id': 'req-93e64cf0-1226-4003-9e6f-17f76fb66db6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:16.940556 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2253bf41281947cdb297cf8acbae184e', 'request_id': 'req-93e64cf0-1226-4003-9e6f-17f76fb66db6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:16.964919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] The token cache is being invalidate because project 2253bf41281947cdb297cf8acbae184e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:16.965255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:16.966240 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:16.970186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 999/2004] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:16 2022] DELETE /identity/v3/projects/2253bf41281947cdb297cf8acbae184e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:16.975161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3673163-2e92-4ff7-bf0c-ac2cbbf1b655 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:16.994105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3673163-2e92-4ff7-bf0c-ac2cbbf1b655 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:17.124238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:17.126528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:17.127048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:17.127929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:17.128158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:17.128480 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] PATH_INFO: `/v3/users/b6a8dead124d450ba4edba76218a7abd` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:17.129707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a8dead124d450ba4edba76218a7abd)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:17.131810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:17.142727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e64cf0-1226-4003-9e6f-17f76fb66db6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:17.154009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:17.154449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:17.154736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:17.155009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] PATH_INFO: `/v3/users/98b69dae8d4a4d4085c6257f63127988` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:17.164965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b69dae8d4a4d4085c6257f63127988)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:17.164965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:17.242212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a8dead124d450ba4edba76218a7abd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.248862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:17.259535 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b69dae8d4a4d4085c6257f63127988'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.264174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a8dead124d450ba4edba76218a7abd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.277771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a8dead124d450ba4edba76218a7abd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.277924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b69dae8d4a4d4085c6257f63127988'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.278556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a8dead124d450ba4edba76218a7abd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.279311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9ff371e0-67b8-42d9-9bd4-bae40ce4cb0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a8dead124d450ba4edba76218a7abd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.288135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b69dae8d4a4d4085c6257f63127988'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.289557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b69dae8d4a4d4085c6257f63127988'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.289970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b69dae8d4a4d4085c6257f63127988'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.297248 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1006/2005] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:16 2022] DELETE /identity/v3/users/b6a8dead124d450ba4edba76218a7abd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:17.306221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1000/2006] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:17 2022] DELETE /identity/v3/users/98b69dae8d4a4d4085c6257f63127988 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:17.316563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07221ce1-ba7b-45e4-913b-97fe05e0967e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:17.316811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07221ce1-ba7b-45e4-913b-97fe05e0967e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:17.317195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07221ce1-ba7b-45e4-913b-97fe05e0967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:17.385111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-07221ce1-ba7b-45e4-913b-97fe05e0967e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:17.386531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-07221ce1-ba7b-45e4-913b-97fe05e0967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:17.476213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1007/2007] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:17.489156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:17.490941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:17.564441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07221ce1-ba7b-45e4-913b-97fe05e0967e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:17.565891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-07221ce1-ba7b-45e4-913b-97fe05e0967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:17.586725 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07221ce1-ba7b-45e4-913b-97fe05e0967e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:17.599534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8481a8-6219-4661-9aff-c6dab865bf5e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:17.602495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:17.602955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:17.603129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:17.604079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] PATH_INFO: `/v3/users/140a45c086e04614932a24b328f46cf7` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:17.604588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5d0b0-288e-4d39-bd5e-e8d13a881691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:17.605144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=140a45c086e04614932a24b328f46cf7)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:17.605518 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5d0b0-288e-4d39-bd5e-e8d13a881691 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:17.605921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5d0b0-288e-4d39-bd5e-e8d13a881691 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:17.606284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5d0b0-288e-4d39-bd5e-e8d13a881691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:17.607756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:17.646834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5d0b0-288e-4d39-bd5e-e8d13a881691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:17.650809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5d0b0-288e-4d39-bd5e-e8d13a881691 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:17.662001 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:17.675336 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1001/2008] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:17.714227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140a45c086e04614932a24b328f46cf7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.726501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5d0b0-288e-4d39-bd5e-e8d13a881691 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:17.728325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dbf5d0b0-288e-4d39-bd5e-e8d13a881691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:17.735991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140a45c086e04614932a24b328f46cf7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.745322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140a45c086e04614932a24b328f46cf7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.746569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140a45c086e04614932a24b328f46cf7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.748508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4680ff28-1d2c-4dcc-b60a-711b87e64e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140a45c086e04614932a24b328f46cf7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:17.770433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1008/2009] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:17 2022] DELETE /identity/v3/users/140a45c086e04614932a24b328f46cf7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:17.776710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0c7a4-9e7d-4cee-a31a-1057215e94fb None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:17.776710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0c7a4-9e7d-4cee-a31a-1057215e94fb None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:17.776710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0c7a4-9e7d-4cee-a31a-1057215e94fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:17.800076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-1fb0c7a4-9e7d-4cee-a31a-1057215e94fb None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:17.801398 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1fb0c7a4-9e7d-4cee-a31a-1057215e94fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:17.807302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5d0b0-288e-4d39-bd5e-e8d13a881691 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:17.851067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:17.871886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07030c-6252-489c-9dd2-eb3f78a0e374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:17.872789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07030c-6252-489c-9dd2-eb3f78a0e374 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:17.873239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07030c-6252-489c-9dd2-eb3f78a0e374 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:17.873553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07030c-6252-489c-9dd2-eb3f78a0e374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:17.875299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-de07030c-6252-489c-9dd2-eb3f78a0e374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:17.884575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1009/2010] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:17.895011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0c7a4-9e7d-4cee-a31a-1057215e94fb None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:17.896526 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1fb0c7a4-9e7d-4cee-a31a-1057215e94fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:17.961364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07030c-6252-489c-9dd2-eb3f78a0e374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:17.963080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07030c-6252-489c-9dd2-eb3f78a0e374 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:17.984576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1002/2011] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:17.985574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07030c-6252-489c-9dd2-eb3f78a0e374 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:17.987208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-de07030c-6252-489c-9dd2-eb3f78a0e374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:17.999884 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0c7a4-9e7d-4cee-a31a-1057215e94fb None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:18.004178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b914-943f-46f6-a01e-b1a24c1c65e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:18.005011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b914-943f-46f6-a01e-b1a24c1c65e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:18.005345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b914-943f-46f6-a01e-b1a24c1c65e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:18.005684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b914-943f-46f6-a01e-b1a24c1c65e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:18.011298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07030c-6252-489c-9dd2-eb3f78a0e374 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:18.017311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:18.018389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:18.018497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b914-943f-46f6-a01e-b1a24c1c65e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:18.019007 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:18.019492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] PATH_INFO: `/v3/projects/e86bd837df884470ae0c3e1513aff560` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:18.020644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b914-943f-46f6-a01e-b1a24c1c65e8 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:18.021354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86bd837df884470ae0c3e1513aff560)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:18.023809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:18.034572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1010/2012] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:18.098010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86bd837df884470ae0c3e1513aff560', 'request_id': 'req-d6e885bf-302a-4805-a076-d20a4b02874e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.113193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86bd837df884470ae0c3e1513aff560', 'request_id': 'req-d6e885bf-302a-4805-a076-d20a4b02874e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.149930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86bd837df884470ae0c3e1513aff560', 'request_id': 'req-d6e885bf-302a-4805-a076-d20a4b02874e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.159334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:18.228419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] The token cache is being invalidate because project e86bd837df884470ae0c3e1513aff560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:18.229468 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.233147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.242861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1003/2013] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:17 2022] DELETE /identity/v3/projects/e86bd837df884470ae0c3e1513aff560 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:18.247436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b45bb-681f-468f-95a7-10c8d845ebc3 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:18.248472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b45bb-681f-468f-95a7-10c8d845ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:18.249155 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b45bb-681f-468f-95a7-10c8d845ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:18.266292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:18.268194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:18.299717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-fb6b45bb-681f-468f-95a7-10c8d845ebc3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:18.301586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-fb6b45bb-681f-468f-95a7-10c8d845ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:18.386009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e885bf-302a-4805-a076-d20a4b02874e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:18.393763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:18.394464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:18.394743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:18.395013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] PATH_INFO: `/v3/projects/ab171de4f7594c53a30b0b762cce651f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:18.396249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab171de4f7594c53a30b0b762cce651f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:18.398287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:18.462829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1011/2014] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:18.471785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7443-25b8-485d-a2dd-f32ef49a3c5b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:18.472071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7443-25b8-485d-a2dd-f32ef49a3c5b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:18.472344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7443-25b8-485d-a2dd-f32ef49a3c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:18.524287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-680e7443-25b8-485d-a2dd-f32ef49a3c5b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:18.527783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab171de4f7594c53a30b0b762cce651f', 'request_id': 'req-68ec3224-9c1c-454a-ae14-93f483f1e706'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.532075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-680e7443-25b8-485d-a2dd-f32ef49a3c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:18.548589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab171de4f7594c53a30b0b762cce651f', 'request_id': 'req-68ec3224-9c1c-454a-ae14-93f483f1e706'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.562233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab171de4f7594c53a30b0b762cce651f', 'request_id': 'req-68ec3224-9c1c-454a-ae14-93f483f1e706'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.584939 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] The token cache is being invalidate because project ab171de4f7594c53a30b0b762cce651f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:18.585998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.586837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.594216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1004/2015] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:18 2022] DELETE /identity/v3/projects/ab171de4f7594c53a30b0b762cce651f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:18.595189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:18.597561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:18.655739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1012/2016] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:18.658331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e7443-25b8-485d-a2dd-f32ef49a3c5b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:18.660114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-680e7443-25b8-485d-a2dd-f32ef49a3c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:18.677752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e7443-25b8-485d-a2dd-f32ef49a3c5b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:18.686218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:18.686934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:18.687278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:18.687571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] PATH_INFO: `/v3/users/428f9ddb0ec241b18dd000fb5fc2fb12` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:18.688786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=428f9ddb0ec241b18dd000fb5fc2fb12)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:18.690861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:18.703379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec3224-9c1c-454a-ae14-93f483f1e706 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:18.710432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:18.711335 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:18.711738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:18.711926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] PATH_INFO: `/v3/projects/00b1686438d64275bcdaaaea02a5a825` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:18.713113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b1686438d64275bcdaaaea02a5a825)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:18.715736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:18.724918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:18.746208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:18.763164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428f9ddb0ec241b18dd000fb5fc2fb12'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.775766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b1686438d64275bcdaaaea02a5a825', 'request_id': 'req-c6585cc9-7dac-4121-b498-61deba117408'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.782074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428f9ddb0ec241b18dd000fb5fc2fb12'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.786550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b1686438d64275bcdaaaea02a5a825', 'request_id': 'req-c6585cc9-7dac-4121-b498-61deba117408'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.796338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428f9ddb0ec241b18dd000fb5fc2fb12'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.797145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428f9ddb0ec241b18dd000fb5fc2fb12'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.797837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b1686438d64275bcdaaaea02a5a825', 'request_id': 'req-c6585cc9-7dac-4121-b498-61deba117408'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.798190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428f9ddb0ec241b18dd000fb5fc2fb12'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.827827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] The token cache is being invalidate because project 00b1686438d64275bcdaaaea02a5a825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:18.827827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.827827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:18.828423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1013/2017] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:18 2022] DELETE /identity/v3/users/428f9ddb0ec241b18dd000fb5fc2fb12 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:18.828423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:18.828574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1005/2018] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:18 2022] DELETE /identity/v3/projects/00b1686438d64275bcdaaaea02a5a825 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:18.840911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:18.850000 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:18.854462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:19.013317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6df93-1b82-42cd-9beb-8cff1021cb3d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.019920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73729e-f7c6-4f34-971e-0dfe60e953b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.020953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73729e-f7c6-4f34-971e-0dfe60e953b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.021295 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73729e-f7c6-4f34-971e-0dfe60e953b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.021489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73729e-f7c6-4f34-971e-0dfe60e953b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.022147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73729e-f7c6-4f34-971e-0dfe60e953b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:19.022467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73729e-f7c6-4f34-971e-0dfe60e953b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.025192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73729e-f7c6-4f34-971e-0dfe60e953b9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.043668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1014/2019] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:19.045469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73729e-f7c6-4f34-971e-0dfe60e953b9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:19.047349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8e73729e-f7c6-4f34-971e-0dfe60e953b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:19.053720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6585cc9-7dac-4121-b498-61deba117408 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.064893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73729e-f7c6-4f34-971e-0dfe60e953b9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.068204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.069038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.069386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.070430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] PATH_INFO: `/v3/users/df5796203f1e4357867fc1fff98aae34` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.071084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a12fe-4d12-4d13-8aa7-09d1dc14ca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.071695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5796203f1e4357867fc1fff98aae34)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.072073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a12fe-4d12-4d13-8aa7-09d1dc14ca29 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.072496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a12fe-4d12-4d13-8aa7-09d1dc14ca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.073341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a12fe-4d12-4d13-8aa7-09d1dc14ca29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.074124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a12fe-4d12-4d13-8aa7-09d1dc14ca29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.074261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.076513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a12fe-4d12-4d13-8aa7-09d1dc14ca29 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.112119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1015/2020] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:19 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:19.113081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a12fe-4d12-4d13-8aa7-09d1dc14ca29 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:19.117785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0e7a12fe-4d12-4d13-8aa7-09d1dc14ca29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:19.140449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5796203f1e4357867fc1fff98aae34'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.153628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5796203f1e4357867fc1fff98aae34'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.163858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5796203f1e4357867fc1fff98aae34'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.164865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5796203f1e4357867fc1fff98aae34'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.165565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5796203f1e4357867fc1fff98aae34'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.199300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1006/2021] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:18 2022] DELETE /identity/v3/users/df5796203f1e4357867fc1fff98aae34 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:19.199300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:19.202634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a12fe-4d12-4d13-8aa7-09d1dc14ca29 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.214366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:19.237453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:19.287337 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9e466-8edc-4358-9a7c-1b88cc63d02f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.287952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9e466-8edc-4358-9a7c-1b88cc63d02f service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.288184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9e466-8edc-4358-9a7c-1b88cc63d02f service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.288460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9e466-8edc-4358-9a7c-1b88cc63d02f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.289373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:19.291364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9ed9e466-8edc-4358-9a7c-1b88cc63d02f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:19.363537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07e52c-b5b2-456f-8c12-f965c8dceade admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.370073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c66ee-a4c3-47c9-bd7a-94f7c29d8106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.370735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c66ee-a4c3-47c9-bd7a-94f7c29d8106 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.371236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c66ee-a4c3-47c9-bd7a-94f7c29d8106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.371574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c66ee-a4c3-47c9-bd7a-94f7c29d8106 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.372285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c66ee-a4c3-47c9-bd7a-94f7c29d8106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.375490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c66ee-a4c3-47c9-bd7a-94f7c29d8106 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.397419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9e466-8edc-4358-9a7c-1b88cc63d02f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.399362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9e466-8edc-4358-9a7c-1b88cc63d02f service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.407065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1007/2022] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:19 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:19.408104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c66ee-a4c3-47c9-bd7a-94f7c29d8106 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:19.410709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-163c66ee-a4c3-47c9-bd7a-94f7c29d8106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:19.416698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1016/2023] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:19.418037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9e466-8edc-4358-9a7c-1b88cc63d02f service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:19.433945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9e466-8edc-4358-9a7c-1b88cc63d02f service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.441833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1557b-d724-44ec-8211-65199e54932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.442609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1557b-d724-44ec-8211-65199e54932e admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.442890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1557b-d724-44ec-8211-65199e54932e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.443194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1557b-d724-44ec-8211-65199e54932e admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.443935 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1557b-d724-44ec-8211-65199e54932e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.445688 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1557b-d724-44ec-8211-65199e54932e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.447891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c66ee-a4c3-47c9-bd7a-94f7c29d8106 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.472710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.473381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.473981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1017/2024] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:19.474104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.478400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] PATH_INFO: `/v3/projects/d9466a743b9849e6b90de9349d6caef4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.478709 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1557b-d724-44ec-8211-65199e54932e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:19.481201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9466a743b9849e6b90de9349d6caef4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.484195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.500021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1557b-d724-44ec-8211-65199e54932e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.521093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2679c7d-b526-4053-8a7d-2637b97facd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.521093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2679c7d-b526-4053-8a7d-2637b97facd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.521093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2679c7d-b526-4053-8a7d-2637b97facd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.521093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2679c7d-b526-4053-8a7d-2637b97facd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.521398 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2679c7d-b526-4053-8a7d-2637b97facd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.530220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2679c7d-b526-4053-8a7d-2637b97facd1 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.552842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1018/2025] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:19.552842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2679c7d-b526-4053-8a7d-2637b97facd1 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:19.558126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9466a743b9849e6b90de9349d6caef4', 'request_id': 'req-afdab95d-a3f9-4a87-831d-0dfc2471b54d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.585747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2679c7d-b526-4053-8a7d-2637b97facd1 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.589851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9466a743b9849e6b90de9349d6caef4', 'request_id': 'req-afdab95d-a3f9-4a87-831d-0dfc2471b54d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.601609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9466a743b9849e6b90de9349d6caef4', 'request_id': 'req-afdab95d-a3f9-4a87-831d-0dfc2471b54d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.622023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] The token cache is being invalidate because project d9466a743b9849e6b90de9349d6caef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:19.622456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.623671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.629099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1008/2026] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:19 2022] DELETE /identity/v3/projects/d9466a743b9849e6b90de9349d6caef4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:19.630996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:19.632525 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:19.685727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8531f3d-b867-44b5-8ae0-18fd9c53e982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.686674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8531f3d-b867-44b5-8ae0-18fd9c53e982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.686957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8531f3d-b867-44b5-8ae0-18fd9c53e982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.687233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8531f3d-b867-44b5-8ae0-18fd9c53e982 admin admin] PATH_INFO: `/v3/projects/a2ef691546cc4493837c51183473fa53/users/9e409b676b3e4fcb9560dda20b169a56/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.706465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8531f3d-b867-44b5-8ae0-18fd9c53e982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ef691546cc4493837c51183473fa53, user_id=9e409b676b3e4fcb9560dda20b169a56, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.709933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8531f3d-b867-44b5-8ae0-18fd9c53e982 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.719732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdab95d-a3f9-4a87-831d-0dfc2471b54d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.730475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1019/2027] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:19 2022] PUT /identity/v3/projects/a2ef691546cc4493837c51183473fa53/users/9e409b676b3e4fcb9560dda20b169a56/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:19.730705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.731575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.731948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.732743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] PATH_INFO: `/v3/users/313e5e568e364b74abcf6c4a73d94eec` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.740589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313e5e568e364b74abcf6c4a73d94eec)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.741105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8531f3d-b867-44b5-8ae0-18fd9c53e982 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:19.742919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b8531f3d-b867-44b5-8ae0-18fd9c53e982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:19.752541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.796855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:19.809019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:19.810822 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313e5e568e364b74abcf6c4a73d94eec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.820993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8531f3d-b867-44b5-8ae0-18fd9c53e982 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:19.825821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313e5e568e364b74abcf6c4a73d94eec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.826313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:19.826955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.827283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.827561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] PATH_INFO: `/v3/projects/6d1469fe854e4a6f971646e3c77ddbd3` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.828699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1469fe854e4a6f971646e3c77ddbd3)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:19.830638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:19.832927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313e5e568e364b74abcf6c4a73d94eec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.833638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313e5e568e364b74abcf6c4a73d94eec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.834250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac875b32-3f35-48da-9585-5838e361f287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313e5e568e364b74abcf6c4a73d94eec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.849231 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1009/2028] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:19 2022] DELETE /identity/v3/users/313e5e568e364b74abcf6c4a73d94eec => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:19.852794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd774-d3eb-473d-b912-c2f986b9ea2f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.852794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd774-d3eb-473d-b912-c2f986b9ea2f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.852794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd774-d3eb-473d-b912-c2f986b9ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.881386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-21fbd774-d3eb-473d-b912-c2f986b9ea2f None None] MFA Rules not processed for user `9e409b676b3e4fcb9560dda20b169a56`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:19.882611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-21fbd774-d3eb-473d-b912-c2f986b9ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:19.891418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1469fe854e4a6f971646e3c77ddbd3', 'request_id': 'req-70447dba-c031-45c3-8d4d-e8d82892d154'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.901481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1469fe854e4a6f971646e3c77ddbd3', 'request_id': 'req-70447dba-c031-45c3-8d4d-e8d82892d154'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.910963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1469fe854e4a6f971646e3c77ddbd3', 'request_id': 'req-70447dba-c031-45c3-8d4d-e8d82892d154'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.932389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] The token cache is being invalidate because project 6d1469fe854e4a6f971646e3c77ddbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:19.932756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.933471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-70447dba-c031-45c3-8d4d-e8d82892d154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:19.936190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1020/2029] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:19 2022] DELETE /identity/v3/projects/6d1469fe854e4a6f971646e3c77ddbd3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:19.941052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b2a6b-a185-4e70-9285-973bea7ab793 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:19.941901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b2a6b-a185-4e70-9285-973bea7ab793 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:19.942194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b2a6b-a185-4e70-9285-973bea7ab793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:19.969036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1010/2030] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:19.972616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-468b2a6b-a185-4e70-9285-973bea7ab793 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:19.972616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-468b2a6b-a185-4e70-9285-973bea7ab793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:19.973815 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbd774-d3eb-473d-b912-c2f986b9ea2f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:19.975753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-21fbd774-d3eb-473d-b912-c2f986b9ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:20.056366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1021/2031] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:20.064602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de79a2-0d1c-45f4-8c66-830da9cb7d05 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.064956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de79a2-0d1c-45f4-8c66-830da9cb7d05 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.065300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de79a2-0d1c-45f4-8c66-830da9cb7d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.074755 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbd774-d3eb-473d-b912-c2f986b9ea2f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.081112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ecbf8-8dc6-4aba-8dee-7b2675ebac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.081810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ecbf8-8dc6-4aba-8dee-7b2675ebac27 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.082091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ecbf8-8dc6-4aba-8dee-7b2675ebac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.082488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ecbf8-8dc6-4aba-8dee-7b2675ebac27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.083307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ecbf8-8dc6-4aba-8dee-7b2675ebac27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.085444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ecbf8-8dc6-4aba-8dee-7b2675ebac27 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.088632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-18de79a2-0d1c-45f4-8c66-830da9cb7d05 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:20.090277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-18de79a2-0d1c-45f4-8c66-830da9cb7d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:20.099921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1022/2032] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:20.104393 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de79a2-0d1c-45f4-8c66-830da9cb7d05 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.116202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de79a2-0d1c-45f4-8c66-830da9cb7d05 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.122542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faee601-7a79-454c-a281-0575e4e0cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.123505 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faee601-7a79-454c-a281-0575e4e0cf90 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.123923 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faee601-7a79-454c-a281-0575e4e0cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.124472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faee601-7a79-454c-a281-0575e4e0cf90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.125174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faee601-7a79-454c-a281-0575e4e0cf90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:20.125527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faee601-7a79-454c-a281-0575e4e0cf90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.127315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faee601-7a79-454c-a281-0575e4e0cf90 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.130382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1011/2033] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:19 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:20.131517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ecbf8-8dc6-4aba-8dee-7b2675ebac27 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.141947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1023/2034] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:23:20.148195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faee601-7a79-454c-a281-0575e4e0cf90 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.170583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faee601-7a79-454c-a281-0575e4e0cf90 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.200133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:20.242576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ecbf8-8dc6-4aba-8dee-7b2675ebac27 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.245993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:20.249268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759400fc-897b-4b80-9b71-35f399c9053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.249897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759400fc-897b-4b80-9b71-35f399c9053a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.250176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759400fc-897b-4b80-9b71-35f399c9053a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.250450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759400fc-897b-4b80-9b71-35f399c9053a admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.251111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759400fc-897b-4b80-9b71-35f399c9053a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.253145 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759400fc-897b-4b80-9b71-35f399c9053a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.260542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0335b27-4b37-4328-ae78-ce811071f589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.261166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0335b27-4b37-4328-ae78-ce811071f589 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.261448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0335b27-4b37-4328-ae78-ce811071f589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.261721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0335b27-4b37-4328-ae78-ce811071f589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.262357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0335b27-4b37-4328-ae78-ce811071f589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.264348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0335b27-4b37-4328-ae78-ce811071f589 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.279287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1012/2035] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:20 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:20.279808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759400fc-897b-4b80-9b71-35f399c9053a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.282955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-759400fc-897b-4b80-9b71-35f399c9053a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:20.297458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1024/2036] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:20 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:20.297458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0335b27-4b37-4328-ae78-ce811071f589 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.298050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759400fc-897b-4b80-9b71-35f399c9053a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.354691 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.355431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.355738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.356014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] PATH_INFO: `/v3/projects/2a272b25c6ba46f4a75789ce9ba4a738` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.357150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a272b25c6ba46f4a75789ce9ba4a738)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.359057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.361487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0335b27-4b37-4328-ae78-ce811071f589 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.367345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025827d-89a1-428e-a3dc-ba052a104dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.367999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025827d-89a1-428e-a3dc-ba052a104dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.368255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025827d-89a1-428e-a3dc-ba052a104dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.368550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025827d-89a1-428e-a3dc-ba052a104dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.369191 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025827d-89a1-428e-a3dc-ba052a104dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.370832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025827d-89a1-428e-a3dc-ba052a104dc9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.381406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1025/2037] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:20.382270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025827d-89a1-428e-a3dc-ba052a104dc9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.392485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025827d-89a1-428e-a3dc-ba052a104dc9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.397725 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f463b2c-1eb3-42cf-80ba-95870196ae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.398301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f463b2c-1eb3-42cf-80ba-95870196ae5b admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.398584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f463b2c-1eb3-42cf-80ba-95870196ae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.398869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f463b2c-1eb3-42cf-80ba-95870196ae5b admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.399525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f463b2c-1eb3-42cf-80ba-95870196ae5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.402034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f463b2c-1eb3-42cf-80ba-95870196ae5b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.414065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a272b25c6ba46f4a75789ce9ba4a738', 'request_id': 'req-7cb2f701-3aec-407c-a951-3f11274cf1d0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:20.421699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a272b25c6ba46f4a75789ce9ba4a738', 'request_id': 'req-7cb2f701-3aec-407c-a951-3f11274cf1d0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:20.428363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1026/2038] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:20 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:20.428363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f463b2c-1eb3-42cf-80ba-95870196ae5b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.429280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a272b25c6ba46f4a75789ce9ba4a738', 'request_id': 'req-7cb2f701-3aec-407c-a951-3f11274cf1d0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:20.436260 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f463b2c-1eb3-42cf-80ba-95870196ae5b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.441262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] The token cache is being invalidate because project 2a272b25c6ba46f4a75789ce9ba4a738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:20.441554 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:20.442213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:20.443745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1013/2039] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:20 2022] DELETE /identity/v3/projects/2a272b25c6ba46f4a75789ce9ba4a738 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:20.444586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.445897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:20.504967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726bbf3-d991-45e3-9899-8d2fb3c75358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.505664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726bbf3-d991-45e3-9899-8d2fb3c75358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.505955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726bbf3-d991-45e3-9899-8d2fb3c75358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.506233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726bbf3-d991-45e3-9899-8d2fb3c75358 admin admin] PATH_INFO: `/v3/projects/95c6ec8c0498497d8eda22f6e5017916/users/b23bd36d9f9647f5acde9d00f34e89fe/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.511388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:20.515546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2f701-3aec-407c-a951-3f11274cf1d0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.522533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed92572-22db-49ed-b547-cf525a0c4514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.523270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92572-22db-49ed-b547-cf525a0c4514 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.523440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726bbf3-d991-45e3-9899-8d2fb3c75358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c6ec8c0498497d8eda22f6e5017916, user_id=b23bd36d9f9647f5acde9d00f34e89fe, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.523608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92572-22db-49ed-b547-cf525a0c4514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.523835 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92572-22db-49ed-b547-cf525a0c4514 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.524486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed92572-22db-49ed-b547-cf525a0c4514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.526788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726bbf3-d991-45e3-9899-8d2fb3c75358 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.526968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed92572-22db-49ed-b547-cf525a0c4514 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.542368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1014/2040] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:20.542368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb517-5b3d-43a1-a4fc-e83e47aab287 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.542368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb517-5b3d-43a1-a4fc-e83e47aab287 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.542368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb517-5b3d-43a1-a4fc-e83e47aab287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.545209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1027/2041] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:20 2022] PUT /identity/v3/projects/95c6ec8c0498497d8eda22f6e5017916/users/b23bd36d9f9647f5acde9d00f34e89fe/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:20.546196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726bbf3-d991-45e3-9899-8d2fb3c75358 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.562250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-852bb517-5b3d-43a1-a4fc-e83e47aab287 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:20.563521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-852bb517-5b3d-43a1-a4fc-e83e47aab287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:20.590006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:20.624400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726bbf3-d991-45e3-9899-8d2fb3c75358 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.630134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a515db2-7e61-417f-b298-8fef521160b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.630766 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a515db2-7e61-417f-b298-8fef521160b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.631033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a515db2-7e61-417f-b298-8fef521160b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.631340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a515db2-7e61-417f-b298-8fef521160b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.631991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a515db2-7e61-417f-b298-8fef521160b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.633592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a515db2-7e61-417f-b298-8fef521160b3 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.636608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1015/2042] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:20.637597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bb517-5b3d-43a1-a4fc-e83e47aab287 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.639518 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-852bb517-5b3d-43a1-a4fc-e83e47aab287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:20.648632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1028/2043] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:20.648632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746db37-e08d-41f4-bb90-ccebadd7a273 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.648632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746db37-e08d-41f4-bb90-ccebadd7a273 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.648632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746db37-e08d-41f4-bb90-ccebadd7a273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.654350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bb517-5b3d-43a1-a4fc-e83e47aab287 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.662114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61926811-e7d1-46f4-a38d-b6d4e126774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.663186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61926811-e7d1-46f4-a38d-b6d4e126774f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.663532 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61926811-e7d1-46f4-a38d-b6d4e126774f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.663802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61926811-e7d1-46f4-a38d-b6d4e126774f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.664621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61926811-e7d1-46f4-a38d-b6d4e126774f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.667765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61926811-e7d1-46f4-a38d-b6d4e126774f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.672708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-d746db37-e08d-41f4-bb90-ccebadd7a273 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:20.674012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d746db37-e08d-41f4-bb90-ccebadd7a273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:20.679370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1016/2044] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:20.680560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61926811-e7d1-46f4-a38d-b6d4e126774f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.685668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1029/2045] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:20.686486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746db37-e08d-41f4-bb90-ccebadd7a273 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.699047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746db37-e08d-41f4-bb90-ccebadd7a273 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.701604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61926811-e7d1-46f4-a38d-b6d4e126774f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.707909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336ee4-00b0-41cb-bf9b-5e85f8ced268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.708236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4fe23-89d6-4f43-a719-99fa9f3fd592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.708627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336ee4-00b0-41cb-bf9b-5e85f8ced268 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.708910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336ee4-00b0-41cb-bf9b-5e85f8ced268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.709099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4fe23-89d6-4f43-a719-99fa9f3fd592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.709208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336ee4-00b0-41cb-bf9b-5e85f8ced268 admin admin] PATH_INFO: `/v3/projects/95c6ec8c0498497d8eda22f6e5017916/users/b23bd36d9f9647f5acde9d00f34e89fe/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.709376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4fe23-89d6-4f43-a719-99fa9f3fd592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.709737 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4fe23-89d6-4f43-a719-99fa9f3fd592 admin admin] PATH_INFO: `/v3/projects/12987adcc149414d89e7cd885cf91e68/users/defc569ce0ac465484fb874d073501f3/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.711741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336ee4-00b0-41cb-bf9b-5e85f8ced268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c6ec8c0498497d8eda22f6e5017916, user_id=b23bd36d9f9647f5acde9d00f34e89fe, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.717890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336ee4-00b0-41cb-bf9b-5e85f8ced268 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.727952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4fe23-89d6-4f43-a719-99fa9f3fd592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12987adcc149414d89e7cd885cf91e68, user_id=defc569ce0ac465484fb874d073501f3, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.731062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4fe23-89d6-4f43-a719-99fa9f3fd592 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.732445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1030/2046] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:20 2022] PUT /identity/v3/projects/95c6ec8c0498497d8eda22f6e5017916/users/b23bd36d9f9647f5acde9d00f34e89fe/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:20.733831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336ee4-00b0-41cb-bf9b-5e85f8ced268 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:20.752492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1017/2047] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:20 2022] PUT /identity/v3/projects/12987adcc149414d89e7cd885cf91e68/users/defc569ce0ac465484fb874d073501f3/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:20.763057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ba66-f8f3-44d7-947f-29c6d43977de None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.763057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ba66-f8f3-44d7-947f-29c6d43977de None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.763057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ba66-f8f3-44d7-947f-29c6d43977de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.788884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e136ba66-f8f3-44d7-947f-29c6d43977de None None] MFA Rules not processed for user `b23bd36d9f9647f5acde9d00f34e89fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:20.790151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e136ba66-f8f3-44d7-947f-29c6d43977de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:20.853028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336ee4-00b0-41cb-bf9b-5e85f8ced268 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:20.897994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1018/2048] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:20.900022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4f34-90f1-4e1d-b93a-8dbd115222ea None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.900444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4f34-90f1-4e1d-b93a-8dbd115222ea None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.901044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4f34-90f1-4e1d-b93a-8dbd115222ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.937254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-54cb4f34-90f1-4e1d-b93a-8dbd115222ea None None] MFA Rules not processed for user `defc569ce0ac465484fb874d073501f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:20.939305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-54cb4f34-90f1-4e1d-b93a-8dbd115222ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:20.969700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbec1e-ab0c-496e-bde9-212fc54481c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:20.970706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbec1e-ab0c-496e-bde9-212fc54481c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:20.971363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbec1e-ab0c-496e-bde9-212fc54481c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:20.971889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbec1e-ab0c-496e-bde9-212fc54481c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:20.973167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbec1e-ab0c-496e-bde9-212fc54481c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:20.973547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbec1e-ab0c-496e-bde9-212fc54481c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:20.975880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbec1e-ab0c-496e-bde9-212fc54481c7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:20.982409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:21.007648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1031/2049] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:21.007648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbec1e-ab0c-496e-bde9-212fc54481c7 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.007648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-11bbec1e-ab0c-496e-bde9-212fc54481c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:21.023072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1019/2050] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:21.024254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb4f34-90f1-4e1d-b93a-8dbd115222ea None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.037821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb4f34-90f1-4e1d-b93a-8dbd115222ea None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.044797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737f5a9-84cc-4ea6-b55d-57d51dcedd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.045453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737f5a9-84cc-4ea6-b55d-57d51dcedd42 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.045738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737f5a9-84cc-4ea6-b55d-57d51dcedd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.046220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737f5a9-84cc-4ea6-b55d-57d51dcedd42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.046960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737f5a9-84cc-4ea6-b55d-57d51dcedd42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.048924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737f5a9-84cc-4ea6-b55d-57d51dcedd42 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.079538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1020/2051] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:21 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:21.083210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbec1e-ab0c-496e-bde9-212fc54481c7 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.084304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737f5a9-84cc-4ea6-b55d-57d51dcedd42 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.085462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:21.136043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef377d6-338f-4c81-a08c-c8acfd36f1f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.136611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef377d6-338f-4c81-a08c-c8acfd36f1f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.136895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef377d6-338f-4c81-a08c-c8acfd36f1f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.137168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef377d6-338f-4c81-a08c-c8acfd36f1f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.138960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bef377d6-338f-4c81-a08c-c8acfd36f1f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:21.149336 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737f5a9-84cc-4ea6-b55d-57d51dcedd42 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.155495 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401440e-6b1e-4224-90f9-3b087ee8c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.156117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401440e-6b1e-4224-90f9-3b087ee8c5ed admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.156392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401440e-6b1e-4224-90f9-3b087ee8c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.156664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401440e-6b1e-4224-90f9-3b087ee8c5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.157566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401440e-6b1e-4224-90f9-3b087ee8c5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.160191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401440e-6b1e-4224-90f9-3b087ee8c5ed admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.199313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1021/2052] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:21 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:21.200227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401440e-6b1e-4224-90f9-3b087ee8c5ed admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.203313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef377d6-338f-4c81-a08c-c8acfd36f1f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.204780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef377d6-338f-4c81-a08c-c8acfd36f1f7 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.215171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1032/2053] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:21.215859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef377d6-338f-4c81-a08c-c8acfd36f1f7 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.228414 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef377d6-338f-4c81-a08c-c8acfd36f1f7 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.288708 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401440e-6b1e-4224-90f9-3b087ee8c5ed admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.297562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466067d-f088-4fbf-92d8-7ffc49ab7e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.298516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466067d-f088-4fbf-92d8-7ffc49ab7e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.298839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466067d-f088-4fbf-92d8-7ffc49ab7e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.299116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466067d-f088-4fbf-92d8-7ffc49ab7e21 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.300265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466067d-f088-4fbf-92d8-7ffc49ab7e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.302562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466067d-f088-4fbf-92d8-7ffc49ab7e21 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.306227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29f56d-c51a-4cce-b6e8-10f062fb9bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.306914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29f56d-c51a-4cce-b6e8-10f062fb9bde admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.307161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29f56d-c51a-4cce-b6e8-10f062fb9bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.307561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29f56d-c51a-4cce-b6e8-10f062fb9bde admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.308631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29f56d-c51a-4cce-b6e8-10f062fb9bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.313658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29f56d-c51a-4cce-b6e8-10f062fb9bde admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.330944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1022/2054] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:21 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:21.335033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466067d-f088-4fbf-92d8-7ffc49ab7e21 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.348126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466067d-f088-4fbf-92d8-7ffc49ab7e21 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.355304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1033/2055] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:21 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:21.355448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede56da-367b-4a01-b041-f8e5cdc7411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.355448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede56da-367b-4a01-b041-f8e5cdc7411e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.355448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede56da-367b-4a01-b041-f8e5cdc7411e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.355448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede56da-367b-4a01-b041-f8e5cdc7411e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.355757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede56da-367b-4a01-b041-f8e5cdc7411e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.357005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29f56d-c51a-4cce-b6e8-10f062fb9bde admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.357287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede56da-367b-4a01-b041-f8e5cdc7411e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.370582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1023/2056] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:21.372128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29f56d-c51a-4cce-b6e8-10f062fb9bde admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.374511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede56da-367b-4a01-b041-f8e5cdc7411e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.379244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19c085-b040-4e4e-8523-95392f84e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.380150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19c085-b040-4e4e-8523-95392f84e415 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.380634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19c085-b040-4e4e-8523-95392f84e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.381124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19c085-b040-4e4e-8523-95392f84e415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.381967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19c085-b040-4e4e-8523-95392f84e415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.384169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19c085-b040-4e4e-8523-95392f84e415 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.391537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede56da-367b-4a01-b041-f8e5cdc7411e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.396959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1034/2057] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:21.401824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19c085-b040-4e4e-8523-95392f84e415 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.403506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3fca-0cab-4499-9924-383cf76c7b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.404364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3fca-0cab-4499-9924-383cf76c7b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.404950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3fca-0cab-4499-9924-383cf76c7b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.405450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3fca-0cab-4499-9924-383cf76c7b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.406246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea3fca-0cab-4499-9924-383cf76c7b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.408153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea3fca-0cab-4499-9924-383cf76c7b75 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.420694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1024/2058] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:21.426483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3fca-0cab-4499-9924-383cf76c7b75 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.429246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19c085-b040-4e4e-8523-95392f84e415 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.435864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7328285-8867-4a76-b302-9772730a3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.436579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7328285-8867-4a76-b302-9772730a3f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.437041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7328285-8867-4a76-b302-9772730a3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.437322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7328285-8867-4a76-b302-9772730a3f20 admin admin] PATH_INFO: `/v3/projects/562a2d4a3fb54daab2c8a2fb5319d241/users/003c1d94d4b34c8f86c3f172bec6ce11/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.440282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:21.445828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3fca-0cab-4499-9924-383cf76c7b75 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.452965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f319701-0e23-4a0d-b3f1-07a3a9ff7595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.455892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319701-0e23-4a0d-b3f1-07a3a9ff7595 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.456360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319701-0e23-4a0d-b3f1-07a3a9ff7595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.456856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319701-0e23-4a0d-b3f1-07a3a9ff7595 admin admin] PATH_INFO: `/v3/projects/3c811c77f0c44fc097574e2d2872af05/users/dcc334bad2ec480b8d355742b730f008/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.463903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7328285-8867-4a76-b302-9772730a3f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562a2d4a3fb54daab2c8a2fb5319d241, user_id=003c1d94d4b34c8f86c3f172bec6ce11, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.466829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7328285-8867-4a76-b302-9772730a3f20 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.481194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f319701-0e23-4a0d-b3f1-07a3a9ff7595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c811c77f0c44fc097574e2d2872af05, user_id=dcc334bad2ec480b8d355742b730f008, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.484676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f319701-0e23-4a0d-b3f1-07a3a9ff7595 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.489885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1035/2059] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:21 2022] PUT /identity/v3/projects/562a2d4a3fb54daab2c8a2fb5319d241/users/003c1d94d4b34c8f86c3f172bec6ce11/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:21.496480 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7328285-8867-4a76-b302-9772730a3f20 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.500782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1025/2060] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:21 2022] PUT /identity/v3/projects/3c811c77f0c44fc097574e2d2872af05/users/dcc334bad2ec480b8d355742b730f008/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:21.518558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3705e0-7312-4957-a1a7-af26ec72a736 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.519290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3705e0-7312-4957-a1a7-af26ec72a736 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.519739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3705e0-7312-4957-a1a7-af26ec72a736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.529323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:21.566932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5e3705e0-7312-4957-a1a7-af26ec72a736 None None] MFA Rules not processed for user `dcc334bad2ec480b8d355742b730f008`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:21.569608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e3705e0-7312-4957-a1a7-af26ec72a736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:21.595549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7328285-8867-4a76-b302-9772730a3f20 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.671627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1026/2061] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:21.674462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3705e0-7312-4957-a1a7-af26ec72a736 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.699796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891ceaf-f6c0-4cdd-ad4f-146a8428ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.700456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891ceaf-f6c0-4cdd-ad4f-146a8428ec32 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.700692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891ceaf-f6c0-4cdd-ad4f-146a8428ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.703473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891ceaf-f6c0-4cdd-ad4f-146a8428ec32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.705485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891ceaf-f6c0-4cdd-ad4f-146a8428ec32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.707138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891ceaf-f6c0-4cdd-ad4f-146a8428ec32 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.732172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1036/2062] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:21.736325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891ceaf-f6c0-4cdd-ad4f-146a8428ec32 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.755431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891ceaf-f6c0-4cdd-ad4f-146a8428ec32 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.762350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0bf1a-4c8c-4898-b405-29256879bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.763342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0bf1a-4c8c-4898-b405-29256879bba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.763627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0bf1a-4c8c-4898-b405-29256879bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.763907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0bf1a-4c8c-4898-b405-29256879bba6 admin admin] PATH_INFO: `/v3/projects/562a2d4a3fb54daab2c8a2fb5319d241/users/003c1d94d4b34c8f86c3f172bec6ce11/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.766864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0bf1a-4c8c-4898-b405-29256879bba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562a2d4a3fb54daab2c8a2fb5319d241, user_id=003c1d94d4b34c8f86c3f172bec6ce11, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.770591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0bf1a-4c8c-4898-b405-29256879bba6 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.784323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1037/2063] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:21 2022] PUT /identity/v3/projects/562a2d4a3fb54daab2c8a2fb5319d241/users/003c1d94d4b34c8f86c3f172bec6ce11/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:21.787533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3705e0-7312-4957-a1a7-af26ec72a736 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:21.795377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ed959-58df-40a8-bf8f-765b5949d060 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.796016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ed959-58df-40a8-bf8f-765b5949d060 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.796623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ed959-58df-40a8-bf8f-765b5949d060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.829849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-bf4ed959-58df-40a8-bf8f-765b5949d060 None None] MFA Rules not processed for user `003c1d94d4b34c8f86c3f172bec6ce11`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:21.831082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bf4ed959-58df-40a8-bf8f-765b5949d060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:21.868943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4967b-831e-4bea-a6e4-2e5e4d90d8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:21.868943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4967b-831e-4bea-a6e4-2e5e4d90d8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:21.869321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4967b-831e-4bea-a6e4-2e5e4d90d8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:21.869760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4967b-831e-4bea-a6e4-2e5e4d90d8e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:21.870476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4967b-831e-4bea-a6e4-2e5e4d90d8e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:21.872677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4967b-831e-4bea-a6e4-2e5e4d90d8e2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:21.905647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1027/2064] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:21 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:21.909731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4967b-831e-4bea-a6e4-2e5e4d90d8e2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.910053 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1038/2065] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:21.917492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:21.918124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ed959-58df-40a8-bf8f-765b5949d060 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:21.956851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:21.997370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ed959-58df-40a8-bf8f-765b5949d060 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:22.003791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4967b-831e-4bea-a6e4-2e5e4d90d8e2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:22.011296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf82bd-c602-493e-84e1-1e4b126f625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:22.011610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf82bd-c602-493e-84e1-1e4b126f625d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:22.011893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf82bd-c602-493e-84e1-1e4b126f625d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:22.012213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf82bd-c602-493e-84e1-1e4b126f625d admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:22.012917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf82bd-c602-493e-84e1-1e4b126f625d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:22.015174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf82bd-c602-493e-84e1-1e4b126f625d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:22.067458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa77589-8a5e-4a2c-a3da-7ea46a65c854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:22.068112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa77589-8a5e-4a2c-a3da-7ea46a65c854 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:22.068398 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa77589-8a5e-4a2c-a3da-7ea46a65c854 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:22.068888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa77589-8a5e-4a2c-a3da-7ea46a65c854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:22.073106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1028/2066] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:21 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:22.074290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf82bd-c602-493e-84e1-1e4b126f625d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:22.091393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf82bd-c602-493e-84e1-1e4b126f625d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:22.103584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c0d5f-fa39-4526-aea7-2abddae80f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:22.105937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c0d5f-fa39-4526-aea7-2abddae80f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:22.106536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c0d5f-fa39-4526-aea7-2abddae80f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:22.106990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c0d5f-fa39-4526-aea7-2abddae80f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:22.108301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c0d5f-fa39-4526-aea7-2abddae80f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:22.109892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c0d5f-fa39-4526-aea7-2abddae80f1a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:22.131300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1029/2067] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:22.134900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c0d5f-fa39-4526-aea7-2abddae80f1a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:22.148263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c0d5f-fa39-4526-aea7-2abddae80f1a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:22.156405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185d4a-f050-45ff-95ef-1fb2c6b6ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:22.157492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185d4a-f050-45ff-95ef-1fb2c6b6ff81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:22.157774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185d4a-f050-45ff-95ef-1fb2c6b6ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:22.158047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185d4a-f050-45ff-95ef-1fb2c6b6ff81 admin admin] PATH_INFO: `/v3/projects/fbe11096e5334190a2b733610a3757e9/users/2d46f8dd61154591829fc611253a8fa8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:22.175872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b185d4a-f050-45ff-95ef-1fb2c6b6ff81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe11096e5334190a2b733610a3757e9, user_id=2d46f8dd61154591829fc611253a8fa8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:22.178807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b185d4a-f050-45ff-95ef-1fb2c6b6ff81 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:22.194865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa77589-8a5e-4a2c-a3da-7ea46a65c854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:22.197829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa77589-8a5e-4a2c-a3da-7ea46a65c854 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:22.209573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1030/2068] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:22 2022] PUT /identity/v3/projects/fbe11096e5334190a2b733610a3757e9/users/2d46f8dd61154591829fc611253a8fa8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:22.210338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1039/2069] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:22.216338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185d4a-f050-45ff-95ef-1fb2c6b6ff81 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:22.310482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185d4a-f050-45ff-95ef-1fb2c6b6ff81 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:22.320972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fadc36-7758-4d4b-bdf7-1c461aa75184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:22.320972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fadc36-7758-4d4b-bdf7-1c461aa75184 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:22.320972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fadc36-7758-4d4b-bdf7-1c461aa75184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:22.320972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fadc36-7758-4d4b-bdf7-1c461aa75184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:22.321321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fadc36-7758-4d4b-bdf7-1c461aa75184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:22.322276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fadc36-7758-4d4b-bdf7-1c461aa75184 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:22.335185 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1031/2070] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:22.338814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa77589-8a5e-4a2c-a3da-7ea46a65c854 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:22.356066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa77589-8a5e-4a2c-a3da-7ea46a65c854 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:22.365860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fadc36-7758-4d4b-bdf7-1c461aa75184 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:22.369347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af20a70-e6bf-4959-8731-457d9d8fa2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:22.370731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20a70-e6bf-4959-8731-457d9d8fa2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:22.371319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20a70-e6bf-4959-8731-457d9d8fa2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:22.371667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20a70-e6bf-4959-8731-457d9d8fa2ec admin admin] PATH_INFO: `/v3/projects/fbe11096e5334190a2b733610a3757e9/users/2d46f8dd61154591829fc611253a8fa8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:22.373828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af20a70-e6bf-4959-8731-457d9d8fa2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe11096e5334190a2b733610a3757e9, user_id=2d46f8dd61154591829fc611253a8fa8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:22.378269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af20a70-e6bf-4959-8731-457d9d8fa2ec admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:22.393783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1040/2071] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:22 2022] PUT /identity/v3/projects/fbe11096e5334190a2b733610a3757e9/users/2d46f8dd61154591829fc611253a8fa8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:22.407063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdada60-20cf-45ed-bd42-57dcab5d7eb7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:22.407321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdada60-20cf-45ed-bd42-57dcab5d7eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:22.407848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdada60-20cf-45ed-bd42-57dcab5d7eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:22.459014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8cdada60-20cf-45ed-bd42-57dcab5d7eb7 None None] MFA Rules not processed for user `2d46f8dd61154591829fc611253a8fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:22.481108 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8cdada60-20cf-45ed-bd42-57dcab5d7eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:22.486242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fadc36-7758-4d4b-bdf7-1c461aa75184 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:22.504128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:22.607301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470b49f-473b-4ad2-96aa-797f1fbe34c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:22.608307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b49f-473b-4ad2-96aa-797f1fbe34c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:22.608597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b49f-473b-4ad2-96aa-797f1fbe34c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:22.608876 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b49f-473b-4ad2-96aa-797f1fbe34c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:22.671467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1041/2072] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:22.702215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470b49f-473b-4ad2-96aa-797f1fbe34c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:22.703837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470b49f-473b-4ad2-96aa-797f1fbe34c9 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:22.715391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1032/2073] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:22.830234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdada60-20cf-45ed-bd42-57dcab5d7eb7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:22.831692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8cdada60-20cf-45ed-bd42-57dcab5d7eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:22.843453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdada60-20cf-45ed-bd42-57dcab5d7eb7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:22.847226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cdb28-2d0e-4842-934c-f90c49c00256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:22.847753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cdb28-2d0e-4842-934c-f90c49c00256 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:22.848089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cdb28-2d0e-4842-934c-f90c49c00256 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:22.848369 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cdb28-2d0e-4842-934c-f90c49c00256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:22.858966 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880cdb28-2d0e-4842-934c-f90c49c00256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:22.860542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880cdb28-2d0e-4842-934c-f90c49c00256 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:22.864831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:22.883535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1042/2074] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:23.134900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470b49f-473b-4ad2-96aa-797f1fbe34c9 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:23.144964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470b49f-473b-4ad2-96aa-797f1fbe34c9 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:23.150061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985c8e5-dbb8-4f11-a17e-01dfa4cab8d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:23.150754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c8e5-dbb8-4f11-a17e-01dfa4cab8d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:23.151032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c8e5-dbb8-4f11-a17e-01dfa4cab8d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:23.151333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c8e5-dbb8-4f11-a17e-01dfa4cab8d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:23.216419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c8e5-dbb8-4f11-a17e-01dfa4cab8d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:23.217919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c8e5-dbb8-4f11-a17e-01dfa4cab8d4 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:23.227499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cdb28-2d0e-4842-934c-f90c49c00256 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:23.228955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-880cdb28-2d0e-4842-934c-f90c49c00256 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:23.233205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1033/2075] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:23.304717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cdb28-2d0e-4842-934c-f90c49c00256 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:23.310436 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:23.311219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:23.311530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:23.311807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] PATH_INFO: `/v3/users/8be2c5e5fd5848acac2015e6f485e06b` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:23.312942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be2c5e5fd5848acac2015e6f485e06b)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:23.314930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:23.372399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be2c5e5fd5848acac2015e6f485e06b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:23.390317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be2c5e5fd5848acac2015e6f485e06b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:23.400565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be2c5e5fd5848acac2015e6f485e06b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:23.401929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be2c5e5fd5848acac2015e6f485e06b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:23.402552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be2c5e5fd5848acac2015e6f485e06b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:23.422507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1043/2076] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:23 2022] DELETE /identity/v3/users/8be2c5e5fd5848acac2015e6f485e06b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:23.427330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ace3-3ae3-4747-8dcd-4d771e7183f3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:23.427498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ace3-3ae3-4747-8dcd-4d771e7183f3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:23.427898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ace3-3ae3-4747-8dcd-4d771e7183f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:23.448782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3a70ace3-3ae3-4747-8dcd-4d771e7183f3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:23.450202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3a70ace3-3ae3-4747-8dcd-4d771e7183f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:23.549559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1034/2077] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:23.559829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:23.562085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:23.667909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c5f9e-0c18-4f2c-b4ee-ab2d45febfe3 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:23.675346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cb054-d28f-4791-a33b-e0cd21cf846b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:23.675346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cb054-d28f-4791-a33b-e0cd21cf846b service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:23.675547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70ace3-3ae3-4747-8dcd-4d771e7183f3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:23.675958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cb054-d28f-4791-a33b-e0cd21cf846b service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:23.676338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cb054-d28f-4791-a33b-e0cd21cf846b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:23.677115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3a70ace3-3ae3-4747-8dcd-4d771e7183f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:23.684869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:23.690531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cb054-d28f-4791-a33b-e0cd21cf846b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:23.691941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70ace3-3ae3-4747-8dcd-4d771e7183f3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:23.692048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cb054-d28f-4791-a33b-e0cd21cf846b service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:23.696957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:23.697731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:23.698017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:23.698296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] PATH_INFO: `/v3/users/53b7032bd152427f94f11f03077d87d3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:23.699620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b7032bd152427f94f11f03077d87d3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:23.701540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:23.703554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1044/2078] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:23.753955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b7032bd152427f94f11f03077d87d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:23.769455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b7032bd152427f94f11f03077d87d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:23.778061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b7032bd152427f94f11f03077d87d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:23.778908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b7032bd152427f94f11f03077d87d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:23.779738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b7032bd152427f94f11f03077d87d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:23.794656 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1035/2079] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:23 2022] DELETE /identity/v3/users/53b7032bd152427f94f11f03077d87d3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:23.799994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a63797-b488-428f-88df-78d8ce4cd3df None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:23.800401 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a63797-b488-428f-88df-78d8ce4cd3df None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:23.800731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a63797-b488-428f-88df-78d8ce4cd3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:23.823355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-c6a63797-b488-428f-88df-78d8ce4cd3df None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:23.824578 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c6a63797-b488-428f-88df-78d8ce4cd3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:23.838744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:23.891188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1045/2080] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:23.902916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:23.904687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:23.969657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc36cd-1790-4390-93d9-66e3413b5dcb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:23.973712 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71251e-a8f4-4803-9fe3-fffbcc055e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:23.974381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71251e-a8f4-4803-9fe3-fffbcc055e19 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:23.974655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71251e-a8f4-4803-9fe3-fffbcc055e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:23.974928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71251e-a8f4-4803-9fe3-fffbcc055e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:23.985262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71251e-a8f4-4803-9fe3-fffbcc055e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:23.985970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a63797-b488-428f-88df-78d8ce4cd3df None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:23.987353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71251e-a8f4-4803-9fe3-fffbcc055e19 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:23.987580 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c6a63797-b488-428f-88df-78d8ce4cd3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:23.998868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1036/2081] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:24.001012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a63797-b488-428f-88df-78d8ce4cd3df None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:24.006160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:24.006908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.007277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.007858 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] PATH_INFO: `/v3/projects/6ed5645dc5e4469381d9c34843bf4a3c` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.008829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed5645dc5e4469381d9c34843bf4a3c)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:24.011287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:24.061851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed5645dc5e4469381d9c34843bf4a3c', 'request_id': 'req-3c277473-01f0-4327-95b8-45b2a5f0eb97'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.069786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed5645dc5e4469381d9c34843bf4a3c', 'request_id': 'req-3c277473-01f0-4327-95b8-45b2a5f0eb97'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.076418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed5645dc5e4469381d9c34843bf4a3c', 'request_id': 'req-3c277473-01f0-4327-95b8-45b2a5f0eb97'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.087085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] The token cache is being invalidate because project 6ed5645dc5e4469381d9c34843bf4a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:24.087395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.088059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3c277473-01f0-4327-95b8-45b2a5f0eb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.089626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1046/2082] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:23 2022] DELETE /identity/v3/projects/6ed5645dc5e4469381d9c34843bf4a3c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:24.094485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3a744-2911-4878-9f5b-ed99134113be None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.094771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3a744-2911-4878-9f5b-ed99134113be None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.095049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3a744-2911-4878-9f5b-ed99134113be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.116406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-66b3a744-2911-4878-9f5b-ed99134113be None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:24.117679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-66b3a744-2911-4878-9f5b-ed99134113be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:24.193850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1037/2083] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:24.201801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a138b51-db87-4743-b773-07956671d382 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.202085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a138b51-db87-4743-b773-07956671d382 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.202361 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a138b51-db87-4743-b773-07956671d382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.222979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7a138b51-db87-4743-b773-07956671d382 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:24.223616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7a138b51-db87-4743-b773-07956671d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:24.232603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1047/2084] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:24.237056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3a744-2911-4878-9f5b-ed99134113be None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:24.247724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3a744-2911-4878-9f5b-ed99134113be None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:24.256622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37c053-3af6-41ae-93c0-4b71c93949bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:24.257330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37c053-3af6-41ae-93c0-4b71c93949bc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.257680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37c053-3af6-41ae-93c0-4b71c93949bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.258023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37c053-3af6-41ae-93c0-4b71c93949bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.259081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37c053-3af6-41ae-93c0-4b71c93949bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:24.259536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37c053-3af6-41ae-93c0-4b71c93949bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:24.261307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37c053-3af6-41ae-93c0-4b71c93949bc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:24.276667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1038/2085] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:23:24.281574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a138b51-db87-4743-b773-07956671d382 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:24.294307 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a138b51-db87-4743-b773-07956671d382 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:24.309803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fed494-4cd6-40ae-a6f8-c9789eb8fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:24.310982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fed494-4cd6-40ae-a6f8-c9789eb8fbba admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.311421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fed494-4cd6-40ae-a6f8-c9789eb8fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.311585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fed494-4cd6-40ae-a6f8-c9789eb8fbba admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.312257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fed494-4cd6-40ae-a6f8-c9789eb8fbba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:24.312456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37c053-3af6-41ae-93c0-4b71c93949bc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:24.314340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fed494-4cd6-40ae-a6f8-c9789eb8fbba admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:24.318971 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bc37c053-3af6-41ae-93c0-4b71c93949bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:24.329670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:24.356466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1048/2086] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:24 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:24.357898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fed494-4cd6-40ae-a6f8-c9789eb8fbba admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:24.359862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f3fed494-4cd6-40ae-a6f8-c9789eb8fbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:24.412050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37c053-3af6-41ae-93c0-4b71c93949bc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:24.451901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fed494-4cd6-40ae-a6f8-c9789eb8fbba admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:24.457554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:24.458312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.458592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.458898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] PATH_INFO: `/v3/projects/2d358311d7124bca8e83a905d20215e6` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.460055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d358311d7124bca8e83a905d20215e6)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:24.461971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:24.469125 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2d67-dfb8-4a3d-bf5a-5f7852f882a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:24.469791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2d67-dfb8-4a3d-bf5a-5f7852f882a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.470073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2d67-dfb8-4a3d-bf5a-5f7852f882a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.470350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2d67-dfb8-4a3d-bf5a-5f7852f882a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.472193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b14b2d67-dfb8-4a3d-bf5a-5f7852f882a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:24.480476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:24.514615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d358311d7124bca8e83a905d20215e6', 'request_id': 'req-8a4062f2-8f59-4961-be20-8c70fffab82e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.522491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d358311d7124bca8e83a905d20215e6', 'request_id': 'req-8a4062f2-8f59-4961-be20-8c70fffab82e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.529602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d358311d7124bca8e83a905d20215e6', 'request_id': 'req-8a4062f2-8f59-4961-be20-8c70fffab82e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.541511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] The token cache is being invalidate because project 2d358311d7124bca8e83a905d20215e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:24.541785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.542649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.544556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1049/2087] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:24 2022] DELETE /identity/v3/projects/2d358311d7124bca8e83a905d20215e6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:24.545277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:24.546670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:24.546781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b2d67-dfb8-4a3d-bf5a-5f7852f882a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:24.548353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b2d67-dfb8-4a3d-bf5a-5f7852f882a6 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:24.558342 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1039/2088] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:24.559234 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2d67-dfb8-4a3d-bf5a-5f7852f882a6 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:24.569798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2d67-dfb8-4a3d-bf5a-5f7852f882a6 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:24.644061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4062f2-8f59-4961-be20-8c70fffab82e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:24.650417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:24.651164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3436dd-6317-4a02-aa1b-9c107bc2be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:24.651391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.651779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.652169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] PATH_INFO: `/v3/users/e1b708b1d6b1434297ed3c2f56e004b5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.652644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3436dd-6317-4a02-aa1b-9c107bc2be3b admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.653499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b708b1d6b1434297ed3c2f56e004b5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:24.655717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:24.655944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3436dd-6317-4a02-aa1b-9c107bc2be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.656499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3436dd-6317-4a02-aa1b-9c107bc2be3b admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.657303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3436dd-6317-4a02-aa1b-9c107bc2be3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:24.660233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3436dd-6317-4a02-aa1b-9c107bc2be3b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:24.672368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:24.692860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1050/2089] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:24 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:24.702721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3436dd-6317-4a02-aa1b-9c107bc2be3b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:24.723997 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3436dd-6317-4a02-aa1b-9c107bc2be3b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:24.734347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d4ac4-017d-445f-97a4-a24335a2109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:24.735289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d4ac4-017d-445f-97a4-a24335a2109b admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.735717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d4ac4-017d-445f-97a4-a24335a2109b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.736122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d4ac4-017d-445f-97a4-a24335a2109b admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.738618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d4ac4-017d-445f-97a4-a24335a2109b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:24.745503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d4ac4-017d-445f-97a4-a24335a2109b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:24.762360 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1051/2090] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:24.762567 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b708b1d6b1434297ed3c2f56e004b5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.764000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d4ac4-017d-445f-97a4-a24335a2109b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:24.774919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d4ac4-017d-445f-97a4-a24335a2109b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:24.780809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee02fc8-10a8-4a5e-aaa4-2b1214908743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:24.781495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee02fc8-10a8-4a5e-aaa4-2b1214908743 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.781772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee02fc8-10a8-4a5e-aaa4-2b1214908743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.782786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee02fc8-10a8-4a5e-aaa4-2b1214908743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.782786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee02fc8-10a8-4a5e-aaa4-2b1214908743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:24.783129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b708b1d6b1434297ed3c2f56e004b5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.784424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee02fc8-10a8-4a5e-aaa4-2b1214908743 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:24.796968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b708b1d6b1434297ed3c2f56e004b5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.797856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b708b1d6b1434297ed3c2f56e004b5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.798583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9369de17-3c56-442b-8fb0-3a092c5a4bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b708b1d6b1434297ed3c2f56e004b5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:24.800586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1052/2091] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:24.805308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee02fc8-10a8-4a5e-aaa4-2b1214908743 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:24.808004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0ee02fc8-10a8-4a5e-aaa4-2b1214908743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:24.822857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee02fc8-10a8-4a5e-aaa4-2b1214908743 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:24.828877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10244776-855d-4bca-abfa-98b63fa53ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:24.829624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10244776-855d-4bca-abfa-98b63fa53ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.829907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10244776-855d-4bca-abfa-98b63fa53ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.830211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10244776-855d-4bca-abfa-98b63fa53ae1 admin admin] PATH_INFO: `/v3/projects/d274f40b3d8345bea1fb43503bfc130b/users/5147e5b03d8a4c2ebe7504ada4a5d038/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.832712 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1040/2092] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:24 2022] DELETE /identity/v3/users/e1b708b1d6b1434297ed3c2f56e004b5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:24.859651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10244776-855d-4bca-abfa-98b63fa53ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d274f40b3d8345bea1fb43503bfc130b, user_id=5147e5b03d8a4c2ebe7504ada4a5d038, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:24.859651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10244776-855d-4bca-abfa-98b63fa53ae1 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:24.874409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1053/2093] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:24 2022] PUT /identity/v3/projects/d274f40b3d8345bea1fb43503bfc130b/users/5147e5b03d8a4c2ebe7504ada4a5d038/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:24.886588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4bc61-5b3a-4635-affa-4d22fae4cca9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:24.886894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4bc61-5b3a-4635-affa-4d22fae4cca9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:24.887239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4bc61-5b3a-4635-affa-4d22fae4cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:24.922226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-83a4bc61-5b3a-4635-affa-4d22fae4cca9 None None] MFA Rules not processed for user `5147e5b03d8a4c2ebe7504ada4a5d038`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:24.923494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-83a4bc61-5b3a-4635-affa-4d22fae4cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:25.053780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1041/2094] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:25.058516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10244776-855d-4bca-abfa-98b63fa53ae1 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:25.158791 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:25.191805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10244776-855d-4bca-abfa-98b63fa53ae1 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:25.204934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be8d6-617a-4959-b08f-9007a23c318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:25.205905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be8d6-617a-4959-b08f-9007a23c318d admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.206372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be8d6-617a-4959-b08f-9007a23c318d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.206998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be8d6-617a-4959-b08f-9007a23c318d admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.208577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4be8d6-617a-4959-b08f-9007a23c318d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:25.211729 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4be8d6-617a-4959-b08f-9007a23c318d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:25.250752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1054/2095] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:25.268132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4bc61-5b3a-4635-affa-4d22fae4cca9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:25.273881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be8d6-617a-4959-b08f-9007a23c318d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:25.275785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0e4be8d6-617a-4959-b08f-9007a23c318d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:25.283932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4bc61-5b3a-4635-affa-4d22fae4cca9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:25.351517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a3e65-7f50-4463-b427-7c0f9a11da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:25.352544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a3e65-7f50-4463-b427-7c0f9a11da32 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.352830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a3e65-7f50-4463-b427-7c0f9a11da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.353099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a3e65-7f50-4463-b427-7c0f9a11da32 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.353825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a3e65-7f50-4463-b427-7c0f9a11da32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:25.356069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a3e65-7f50-4463-b427-7c0f9a11da32 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:25.381890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1042/2096] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:25 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:25.382111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be8d6-617a-4959-b08f-9007a23c318d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:25.383146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a3e65-7f50-4463-b427-7c0f9a11da32 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:25.388096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:25.388915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.389245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.390116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] PATH_INFO: `/v3/projects/25d9adc644ab4d369befbe032dce7450` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.390754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d9adc644ab4d369befbe032dce7450)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:25.392894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:25.394124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a3e65-7f50-4463-b427-7c0f9a11da32 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:25.399926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a0732-75d1-47b7-b3e1-fda7d3df1cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:25.400598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a0732-75d1-47b7-b3e1-fda7d3df1cee admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.400872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a0732-75d1-47b7-b3e1-fda7d3df1cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.401172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a0732-75d1-47b7-b3e1-fda7d3df1cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.401839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a0732-75d1-47b7-b3e1-fda7d3df1cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:25.403724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a0732-75d1-47b7-b3e1-fda7d3df1cee admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:25.406530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:25.416536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1043/2097] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:25.420706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a0732-75d1-47b7-b3e1-fda7d3df1cee admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:25.432075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a0732-75d1-47b7-b3e1-fda7d3df1cee admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:25.446180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d9adc644ab4d369befbe032dce7450', 'request_id': 'req-64a470a5-5d01-422d-b0d1-425907e8b747'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.454956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d9adc644ab4d369befbe032dce7450', 'request_id': 'req-64a470a5-5d01-422d-b0d1-425907e8b747'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.466095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d9adc644ab4d369befbe032dce7450', 'request_id': 'req-64a470a5-5d01-422d-b0d1-425907e8b747'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.480772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] The token cache is being invalidate because project 25d9adc644ab4d369befbe032dce7450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:25.481070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.481773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.487363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1055/2098] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:25 2022] DELETE /identity/v3/projects/25d9adc644ab4d369befbe032dce7450 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:25.488205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:25.489596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:25.494535 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208c7fe-c888-4cd4-a804-93153059a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:25.495412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208c7fe-c888-4cd4-a804-93153059a22a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.495788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208c7fe-c888-4cd4-a804-93153059a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.496065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208c7fe-c888-4cd4-a804-93153059a22a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.496716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208c7fe-c888-4cd4-a804-93153059a22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:25.498369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208c7fe-c888-4cd4-a804-93153059a22a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:25.502446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a470a5-5d01-422d-b0d1-425907e8b747 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:25.507221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:25.507894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.508215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.508526 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] PATH_INFO: `/v3/users/2c31971d4e384b308f1bdf24c3eba57e` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.508614 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1044/2099] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:25.509517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208c7fe-c888-4cd4-a804-93153059a22a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:25.513041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c31971d4e384b308f1bdf24c3eba57e)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:25.513662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9208c7fe-c888-4cd4-a804-93153059a22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:25.514974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:25.526321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208c7fe-c888-4cd4-a804-93153059a22a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:25.530938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:25.531597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.531877 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.532168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] PATH_INFO: `/v3/users/defc569ce0ac465484fb874d073501f3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.533274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=defc569ce0ac465484fb874d073501f3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:25.535183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:25.576197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c31971d4e384b308f1bdf24c3eba57e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.585292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:25.590784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defc569ce0ac465484fb874d073501f3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.591099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c31971d4e384b308f1bdf24c3eba57e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.599336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c31971d4e384b308f1bdf24c3eba57e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.599999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c31971d4e384b308f1bdf24c3eba57e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.600614 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c31971d4e384b308f1bdf24c3eba57e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.606701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defc569ce0ac465484fb874d073501f3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.616040 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defc569ce0ac465484fb874d073501f3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.616732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defc569ce0ac465484fb874d073501f3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.617237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1056/2100] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:25 2022] DELETE /identity/v3/users/2c31971d4e384b308f1bdf24c3eba57e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:25.617363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0d69d5b4-fec6-49fb-8b1f-15179dd7c3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defc569ce0ac465484fb874d073501f3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:25.618270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:25.619899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:25.633680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1045/2101] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:25 2022] DELETE /identity/v3/users/defc569ce0ac465484fb874d073501f3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:25.638245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c5109-ae1f-44fe-90c8-fbe86dc8ce9f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.638573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c5109-ae1f-44fe-90c8-fbe86dc8ce9f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.642379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c5109-ae1f-44fe-90c8-fbe86dc8ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.667202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bd9c5109-ae1f-44fe-90c8-fbe86dc8ce9f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:25.668557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bd9c5109-ae1f-44fe-90c8-fbe86dc8ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:25.701971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78a176-7c87-4c32-a172-98f524bf22c8 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:25.742087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1046/2102] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:25.752306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c5109-ae1f-44fe-90c8-fbe86dc8ce9f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:25.754638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bd9c5109-ae1f-44fe-90c8-fbe86dc8ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:25.768069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:25.769383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f95b89-2d8c-4385-887c-ef28befdb821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:25.770886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95b89-2d8c-4385-887c-ef28befdb821 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.770886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95b89-2d8c-4385-887c-ef28befdb821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.771663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95b89-2d8c-4385-887c-ef28befdb821 admin admin] PATH_INFO: `/v3/projects/91e05b3804f84491a7449a57591b7e7f/users/83a6160f8bb64db58bc88e4fa12d154f/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.802332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f95b89-2d8c-4385-887c-ef28befdb821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e05b3804f84491a7449a57591b7e7f, user_id=83a6160f8bb64db58bc88e4fa12d154f, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:25.805192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f95b89-2d8c-4385-887c-ef28befdb821 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:25.823195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1057/2103] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:25 2022] PUT /identity/v3/projects/91e05b3804f84491a7449a57591b7e7f/users/83a6160f8bb64db58bc88e4fa12d154f/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:25.835864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c6d5b-b1ae-4645-8a88-c1538519c0be None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.836278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c6d5b-b1ae-4645-8a88-c1538519c0be None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.836561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c6d5b-b1ae-4645-8a88-c1538519c0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.840349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c5109-ae1f-44fe-90c8-fbe86dc8ce9f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:25.866826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-902c6d5b-b1ae-4645-8a88-c1538519c0be None None] MFA Rules not processed for user `83a6160f8bb64db58bc88e4fa12d154f`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:25.868131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-902c6d5b-b1ae-4645-8a88-c1538519c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:25.895274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855ebce-2654-4393-8e2e-a8fc1f76c787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:25.895950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855ebce-2654-4393-8e2e-a8fc1f76c787 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:25.896168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855ebce-2654-4393-8e2e-a8fc1f76c787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:25.896461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855ebce-2654-4393-8e2e-a8fc1f76c787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:25.937175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:25.958287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1058/2104] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:25.959123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c6d5b-b1ae-4645-8a88-c1538519c0be None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:25.967429 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-902c6d5b-b1ae-4645-8a88-c1538519c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:25.993351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855ebce-2654-4393-8e2e-a8fc1f76c787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:25.995344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855ebce-2654-4393-8e2e-a8fc1f76c787 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.005998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1047/2105] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:26.006932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855ebce-2654-4393-8e2e-a8fc1f76c787 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.008065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6855ebce-2654-4393-8e2e-a8fc1f76c787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:26.020817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855ebce-2654-4393-8e2e-a8fc1f76c787 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.026365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150aed2-f058-4900-9ce4-d881d2d66a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.027438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150aed2-f058-4900-9ce4-d881d2d66a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.027570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150aed2-f058-4900-9ce4-d881d2d66a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.027854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150aed2-f058-4900-9ce4-d881d2d66a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.028519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150aed2-f058-4900-9ce4-d881d2d66a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.030479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150aed2-f058-4900-9ce4-d881d2d66a40 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.047411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c6d5b-b1ae-4645-8a88-c1538519c0be None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.053850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.054497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.054823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.055096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] PATH_INFO: `/v3/projects/bb11dc11e0a04210abc5746c5526b496` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.057332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb11dc11e0a04210abc5746c5526b496)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.059374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.084228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1048/2106] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:26 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:26.089402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150aed2-f058-4900-9ce4-d881d2d66a40 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.126396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb11dc11e0a04210abc5746c5526b496', 'request_id': 'req-fa221d93-ae69-4a55-87e0-afc95938f44b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.156703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb11dc11e0a04210abc5746c5526b496', 'request_id': 'req-fa221d93-ae69-4a55-87e0-afc95938f44b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.165286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:26.167388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb11dc11e0a04210abc5746c5526b496', 'request_id': 'req-fa221d93-ae69-4a55-87e0-afc95938f44b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.183478 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] The token cache is being invalidate because project bb11dc11e0a04210abc5746c5526b496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:26.183838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.184628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-fa221d93-ae69-4a55-87e0-afc95938f44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.186620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1059/2107] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:25 2022] DELETE /identity/v3/projects/bb11dc11e0a04210abc5746c5526b496 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:26.192789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebd199-e822-4384-b086-421f1bdd611c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.193165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebd199-e822-4384-b086-421f1bdd611c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.193622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebd199-e822-4384-b086-421f1bdd611c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.202548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150aed2-f058-4900-9ce4-d881d2d66a40 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.217868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-cdebd199-e822-4384-b086-421f1bdd611c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:26.224568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-cdebd199-e822-4384-b086-421f1bdd611c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:26.293166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747cf2b-74a2-4e99-82de-cb6c65155723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.294881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747cf2b-74a2-4e99-82de-cb6c65155723 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.294881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747cf2b-74a2-4e99-82de-cb6c65155723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.295083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747cf2b-74a2-4e99-82de-cb6c65155723 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.295654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747cf2b-74a2-4e99-82de-cb6c65155723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.297754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747cf2b-74a2-4e99-82de-cb6c65155723 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.332475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1049/2108] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:26 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:26.352927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747cf2b-74a2-4e99-82de-cb6c65155723 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.358436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5747cf2b-74a2-4e99-82de-cb6c65155723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:26.373350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747cf2b-74a2-4e99-82de-cb6c65155723 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.380003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b62c8-9888-4738-bb40-4c93f40bca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.380662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b62c8-9888-4738-bb40-4c93f40bca32 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.380987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b62c8-9888-4738-bb40-4c93f40bca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.381255 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b62c8-9888-4738-bb40-4c93f40bca32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.381907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b62c8-9888-4738-bb40-4c93f40bca32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.383529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b62c8-9888-4738-bb40-4c93f40bca32 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.387358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1060/2109] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:26.387358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530447ac-f5a6-4a5f-9a76-d35da2f49f43 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.387545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530447ac-f5a6-4a5f-9a76-d35da2f49f43 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.387774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530447ac-f5a6-4a5f-9a76-d35da2f49f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.421473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1050/2110] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:26.422508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b62c8-9888-4738-bb40-4c93f40bca32 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.425497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-944b62c8-9888-4738-bb40-4c93f40bca32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:26.430354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-530447ac-f5a6-4a5f-9a76-d35da2f49f43 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:26.431562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-530447ac-f5a6-4a5f-9a76-d35da2f49f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:26.447094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b62c8-9888-4738-bb40-4c93f40bca32 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.458817 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1061/2111] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:26.459817 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530447ac-f5a6-4a5f-9a76-d35da2f49f43 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.473969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.474783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.475194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.475748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530447ac-f5a6-4a5f-9a76-d35da2f49f43 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.476038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] PATH_INFO: `/v3/projects/12987adcc149414d89e7cd885cf91e68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.478139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12987adcc149414d89e7cd885cf91e68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.480744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.481539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65a4fe-d646-4141-a013-a9209e2c9504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.482063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65a4fe-d646-4141-a013-a9209e2c9504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.482340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65a4fe-d646-4141-a013-a9209e2c9504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.483864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65a4fe-d646-4141-a013-a9209e2c9504 admin admin] PATH_INFO: `/v3/projects/f4284e86e0c24048baa1e629bbbeb6ec/users/81e2ad0a01f9494381ee703f4e59f061/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.499473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65a4fe-d646-4141-a013-a9209e2c9504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4284e86e0c24048baa1e629bbbeb6ec, user_id=81e2ad0a01f9494381ee703f4e59f061, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.502270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65a4fe-d646-4141-a013-a9209e2c9504 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.510669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:26.530608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1062/2112] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:26 2022] PUT /identity/v3/projects/f4284e86e0c24048baa1e629bbbeb6ec/users/81e2ad0a01f9494381ee703f4e59f061/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:26.534995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65a4fe-d646-4141-a013-a9209e2c9504 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.581084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12987adcc149414d89e7cd885cf91e68', 'request_id': 'req-4abf3d46-97ac-4603-a055-279453851617'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.591121 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12987adcc149414d89e7cd885cf91e68', 'request_id': 'req-4abf3d46-97ac-4603-a055-279453851617'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.598727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12987adcc149414d89e7cd885cf91e68', 'request_id': 'req-4abf3d46-97ac-4603-a055-279453851617'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.611525 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] The token cache is being invalidate because project 12987adcc149414d89e7cd885cf91e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:26.611915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.612652 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.614516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1051/2113] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:26 2022] DELETE /identity/v3/projects/12987adcc149414d89e7cd885cf91e68 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:26.615662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.619562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:26.628328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65a4fe-d646-4141-a013-a9209e2c9504 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.717125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af952a-fb35-46d3-bf6c-f66a3d44bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.717876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af952a-fb35-46d3-bf6c-f66a3d44bbaf admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.718228 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af952a-fb35-46d3-bf6c-f66a3d44bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.718899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af952a-fb35-46d3-bf6c-f66a3d44bbaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.719615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af952a-fb35-46d3-bf6c-f66a3d44bbaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:26.719982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af952a-fb35-46d3-bf6c-f66a3d44bbaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.721802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af952a-fb35-46d3-bf6c-f66a3d44bbaf admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.728229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3d46-97ac-4603-a055-279453851617 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.734115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715d4a2-857c-4dde-8910-a7d2926a011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.734616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715d4a2-857c-4dde-8910-a7d2926a011a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.734989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715d4a2-857c-4dde-8910-a7d2926a011a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.735397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715d4a2-857c-4dde-8910-a7d2926a011a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.736149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715d4a2-857c-4dde-8910-a7d2926a011a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.738666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715d4a2-857c-4dde-8910-a7d2926a011a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.740352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:26.748369 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1063/2114] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:26.750137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af952a-fb35-46d3-bf6c-f66a3d44bbaf admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.753755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d3af952a-fb35-46d3-bf6c-f66a3d44bbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:26.759562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1052/2115] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:26.761484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715d4a2-857c-4dde-8910-a7d2926a011a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.764574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9715d4a2-857c-4dde-8910-a7d2926a011a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:26.781719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715d4a2-857c-4dde-8910-a7d2926a011a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.786793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985414db-6071-412a-b753-e7d282e8dbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.787556 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985414db-6071-412a-b753-e7d282e8dbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.787925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985414db-6071-412a-b753-e7d282e8dbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.788256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985414db-6071-412a-b753-e7d282e8dbe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.788956 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985414db-6071-412a-b753-e7d282e8dbe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.790200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af952a-fb35-46d3-bf6c-f66a3d44bbaf admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.791020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985414db-6071-412a-b753-e7d282e8dbe3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.799766 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.800439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.800834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.801111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] PATH_INFO: `/v3/users/003c1d94d4b34c8f86c3f172bec6ce11` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.802530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=003c1d94d4b34c8f86c3f172bec6ce11)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.804493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.843863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1053/2116] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:26 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:26.843863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985414db-6071-412a-b753-e7d282e8dbe3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.866720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003c1d94d4b34c8f86c3f172bec6ce11'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.891666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003c1d94d4b34c8f86c3f172bec6ce11'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.902117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003c1d94d4b34c8f86c3f172bec6ce11'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.903629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003c1d94d4b34c8f86c3f172bec6ce11'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.904355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003c1d94d4b34c8f86c3f172bec6ce11'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:26.918128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985414db-6071-412a-b753-e7d282e8dbe3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:26.923512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94600c5-d3cb-4bea-858c-4c1712a3338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:26.924799 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94600c5-d3cb-4bea-858c-4c1712a3338e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.925134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94600c5-d3cb-4bea-858c-4c1712a3338e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.925626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94600c5-d3cb-4bea-858c-4c1712a3338e admin admin] PATH_INFO: `/v3/projects/f4284e86e0c24048baa1e629bbbeb6ec/users/81e2ad0a01f9494381ee703f4e59f061/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:26.927774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94600c5-d3cb-4bea-858c-4c1712a3338e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4284e86e0c24048baa1e629bbbeb6ec, user_id=81e2ad0a01f9494381ee703f4e59f061, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:26.930522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1064/2117] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:26 2022] DELETE /identity/v3/users/003c1d94d4b34c8f86c3f172bec6ce11 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:26.930747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94600c5-d3cb-4bea-858c-4c1712a3338e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:26.934612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:26.936599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:26.951491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1054/2118] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:26 2022] PUT /identity/v3/projects/f4284e86e0c24048baa1e629bbbeb6ec/users/81e2ad0a01f9494381ee703f4e59f061/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:26.951805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:26.954950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e514b9-1907-48d4-9b06-f50b48c561eb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:26.956217 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e514b9-1907-48d4-9b06-f50b48c561eb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:26.956565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e514b9-1907-48d4-9b06-f50b48c561eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.002948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-94e514b9-1907-48d4-9b06-f50b48c561eb None None] MFA Rules not processed for user `81e2ad0a01f9494381ee703f4e59f061`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:27.004386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-94e514b9-1907-48d4-9b06-f50b48c561eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:27.021469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81cd27-1935-46db-864a-fa1141449b4f admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:27.132569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1055/2119] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:27.136918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173375dc-738c-4c3c-b5ff-c168a779c15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:27.137743 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173375dc-738c-4c3c-b5ff-c168a779c15f admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.138184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173375dc-738c-4c3c-b5ff-c168a779c15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.138599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173375dc-738c-4c3c-b5ff-c168a779c15f admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.139410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173375dc-738c-4c3c-b5ff-c168a779c15f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:27.141814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173375dc-738c-4c3c-b5ff-c168a779c15f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:27.142015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e514b9-1907-48d4-9b06-f50b48c561eb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:27.144077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-94e514b9-1907-48d4-9b06-f50b48c561eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:27.177655 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1065/2120] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:26 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:27.182068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173375dc-738c-4c3c-b5ff-c168a779c15f admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:27.205932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173375dc-738c-4c3c-b5ff-c168a779c15f admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:27.214235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196145e5-41f6-4ee3-a608-e124f3c915d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:27.214235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196145e5-41f6-4ee3-a608-e124f3c915d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.214235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196145e5-41f6-4ee3-a608-e124f3c915d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.214518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196145e5-41f6-4ee3-a608-e124f3c915d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.215289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196145e5-41f6-4ee3-a608-e124f3c915d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:27.217323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196145e5-41f6-4ee3-a608-e124f3c915d4 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:27.233028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1066/2121] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:27.235198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196145e5-41f6-4ee3-a608-e124f3c915d4 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:27.241386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e514b9-1907-48d4-9b06-f50b48c561eb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:27.248156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e1d91-27dd-40c6-97ec-d2bd1f3ecbf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:27.249111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e1d91-27dd-40c6-97ec-d2bd1f3ecbf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.249550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e1d91-27dd-40c6-97ec-d2bd1f3ecbf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.250013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e1d91-27dd-40c6-97ec-d2bd1f3ecbf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.252195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9d8e1d91-27dd-40c6-97ec-d2bd1f3ecbf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:27.252420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196145e5-41f6-4ee3-a608-e124f3c915d4 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:27.259094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd69bb-f892-4578-a475-1a3e02dfdee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:27.260314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd69bb-f892-4578-a475-1a3e02dfdee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.260685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd69bb-f892-4578-a475-1a3e02dfdee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.261038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd69bb-f892-4578-a475-1a3e02dfdee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.261746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:27.262281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd69bb-f892-4578-a475-1a3e02dfdee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:27.264259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd69bb-f892-4578-a475-1a3e02dfdee4 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:27.278665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1067/2122] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:27.282522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd69bb-f892-4578-a475-1a3e02dfdee4 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:27.296787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd69bb-f892-4578-a475-1a3e02dfdee4 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:27.302319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac437b9-4cc0-4944-b8f6-a8d39964bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:27.303407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac437b9-4cc0-4944-b8f6-a8d39964bf0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.303883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac437b9-4cc0-4944-b8f6-a8d39964bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.304345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac437b9-4cc0-4944-b8f6-a8d39964bf0e admin admin] PATH_INFO: `/v3/projects/7305f00e930244cbb2dfe3bcb95ad59d/users/f6141216ae1c472ea7f7195ac18d4849/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.324785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac437b9-4cc0-4944-b8f6-a8d39964bf0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7305f00e930244cbb2dfe3bcb95ad59d, user_id=f6141216ae1c472ea7f7195ac18d4849, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:27.328356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac437b9-4cc0-4944-b8f6-a8d39964bf0e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:27.354411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1068/2123] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:27 2022] PUT /identity/v3/projects/7305f00e930244cbb2dfe3bcb95ad59d/users/f6141216ae1c472ea7f7195ac18d4849/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:27.364318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e1d91-27dd-40c6-97ec-d2bd1f3ecbf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:27.365932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e1d91-27dd-40c6-97ec-d2bd1f3ecbf9 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:27.366841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf1826-6203-4029-a7b3-3b593fb6f587 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.367374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf1826-6203-4029-a7b3-3b593fb6f587 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.367843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf1826-6203-4029-a7b3-3b593fb6f587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.388421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1056/2124] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:27.407815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-bedf1826-6203-4029-a7b3-3b593fb6f587 None None] MFA Rules not processed for user `f6141216ae1c472ea7f7195ac18d4849`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:27.409214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bedf1826-6203-4029-a7b3-3b593fb6f587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:27.413669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e1d91-27dd-40c6-97ec-d2bd1f3ecbf9 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:27.416668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9d8e1d91-27dd-40c6-97ec-d2bd1f3ecbf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:27.453045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e1d91-27dd-40c6-97ec-d2bd1f3ecbf9 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:27.489363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:27.519623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1069/2125] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:27.535510 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf1826-6203-4029-a7b3-3b593fb6f587 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:27.537442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bedf1826-6203-4029-a7b3-3b593fb6f587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:27.545760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:27.546595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.546962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.547404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] PATH_INFO: `/v3/projects/562a2d4a3fb54daab2c8a2fb5319d241` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.550461 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562a2d4a3fb54daab2c8a2fb5319d241)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:27.552249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:27.613960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf1826-6203-4029-a7b3-3b593fb6f587 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:27.623039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562a2d4a3fb54daab2c8a2fb5319d241', 'request_id': 'req-514b3d64-fb29-4a85-be42-958a84e41fa2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:27.634055 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562a2d4a3fb54daab2c8a2fb5319d241', 'request_id': 'req-514b3d64-fb29-4a85-be42-958a84e41fa2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:27.644058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562a2d4a3fb54daab2c8a2fb5319d241', 'request_id': 'req-514b3d64-fb29-4a85-be42-958a84e41fa2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:27.667403 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] The token cache is being invalidate because project 562a2d4a3fb54daab2c8a2fb5319d241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:27.667696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:27.668740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-514b3d64-fb29-4a85-be42-958a84e41fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:27.670452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1057/2126] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:27 2022] DELETE /identity/v3/projects/562a2d4a3fb54daab2c8a2fb5319d241 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:27.675306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60a606-962f-4969-a5bb-8a4826a325d3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.675660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60a606-962f-4969-a5bb-8a4826a325d3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.676422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60a606-962f-4969-a5bb-8a4826a325d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.682101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df19de0-f6ec-46bc-b825-b45ff28cec3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:27.683098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df19de0-f6ec-46bc-b825-b45ff28cec3e service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.683407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df19de0-f6ec-46bc-b825-b45ff28cec3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.683719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df19de0-f6ec-46bc-b825-b45ff28cec3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.685945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5df19de0-f6ec-46bc-b825-b45ff28cec3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:27.699810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-de60a606-962f-4969-a5bb-8a4826a325d3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:27.701229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-de60a606-962f-4969-a5bb-8a4826a325d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:27.746440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:27.768637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df19de0-f6ec-46bc-b825-b45ff28cec3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:27.770102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df19de0-f6ec-46bc-b825-b45ff28cec3e service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:27.796408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1070/2127] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:27.805318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1058/2128] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:27.807201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0728fa-a19f-4243-933c-c2b6a98a6c80 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.808242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0728fa-a19f-4243-933c-c2b6a98a6c80 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.808595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0728fa-a19f-4243-933c-c2b6a98a6c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.845082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4d0728fa-a19f-4243-933c-c2b6a98a6c80 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:27.846768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4d0728fa-a19f-4243-933c-c2b6a98a6c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:27.860326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1071/2129] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:27.865068 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60a606-962f-4969-a5bb-8a4826a325d3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:27.879093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60a606-962f-4969-a5bb-8a4826a325d3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:27.889289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ffcd9-8e7e-4a3f-822e-04907c839a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:27.890186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ffcd9-8e7e-4a3f-822e-04907c839a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.891409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ffcd9-8e7e-4a3f-822e-04907c839a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.892244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ffcd9-8e7e-4a3f-822e-04907c839a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.893158 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ffcd9-8e7e-4a3f-822e-04907c839a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:27.893634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ffcd9-8e7e-4a3f-822e-04907c839a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:27.896096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ffcd9-8e7e-4a3f-822e-04907c839a94 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:27.924294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1059/2130] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:27.930116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0728fa-a19f-4243-933c-c2b6a98a6c80 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:27.959968 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0728fa-a19f-4243-933c-c2b6a98a6c80 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:27.977697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf0d07-294d-4c4f-b96a-80a2376aac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:27.978516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0d07-294d-4c4f-b96a-80a2376aac6e admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:27.979366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0d07-294d-4c4f-b96a-80a2376aac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:27.979660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0d07-294d-4c4f-b96a-80a2376aac6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:27.980387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf0d07-294d-4c4f-b96a-80a2376aac6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:27.983958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf0d07-294d-4c4f-b96a-80a2376aac6e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:28.033311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1072/2131] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:27 2022] POST /identity/v3/projects => generated 407 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:28.037581 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ffcd9-8e7e-4a3f-822e-04907c839a94 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:28.049077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ffcd9-8e7e-4a3f-822e-04907c839a94 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:28.141892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819823b-e952-4d2d-bb4a-8f7ba0a57336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:28.142750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819823b-e952-4d2d-bb4a-8f7ba0a57336 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:28.144118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819823b-e952-4d2d-bb4a-8f7ba0a57336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:28.144610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819823b-e952-4d2d-bb4a-8f7ba0a57336 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:28.145776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819823b-e952-4d2d-bb4a-8f7ba0a57336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:28.148471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819823b-e952-4d2d-bb4a-8f7ba0a57336 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:28.219319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1060/2132] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:28 2022] POST /identity/v3/users => generated 304 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:28.223839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf0d07-294d-4c4f-b96a-80a2376aac6e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:28.238234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf0d07-294d-4c4f-b96a-80a2376aac6e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:28.247509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263861a-288b-4cf0-8858-afaa450d8984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:28.248991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263861a-288b-4cf0-8858-afaa450d8984 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:28.249605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263861a-288b-4cf0-8858-afaa450d8984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:28.250469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263861a-288b-4cf0-8858-afaa450d8984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:28.251544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263861a-288b-4cf0-8858-afaa450d8984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:28.254565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263861a-288b-4cf0-8858-afaa450d8984 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:28.280785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1073/2133] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:28.285530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819823b-e952-4d2d-bb4a-8f7ba0a57336 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:28.300821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819823b-e952-4d2d-bb4a-8f7ba0a57336 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:28.307404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30afc85-1899-41a8-8ac2-f902d59dfeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:28.308208 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30afc85-1899-41a8-8ac2-f902d59dfeba admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:28.308487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30afc85-1899-41a8-8ac2-f902d59dfeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:28.308828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30afc85-1899-41a8-8ac2-f902d59dfeba admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:28.309640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30afc85-1899-41a8-8ac2-f902d59dfeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:28.311625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30afc85-1899-41a8-8ac2-f902d59dfeba admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:28.326129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1061/2134] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:28.330981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263861a-288b-4cf0-8858-afaa450d8984 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:28.345272 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263861a-288b-4cf0-8858-afaa450d8984 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:28.350893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6c329-8835-4032-b0c5-bd4b2edbcd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:28.352112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c329-8835-4032-b0c5-bd4b2edbcd48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:28.352397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c329-8835-4032-b0c5-bd4b2edbcd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:28.352673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c329-8835-4032-b0c5-bd4b2edbcd48 admin admin] PATH_INFO: `/v3/projects/905aba7a2b3642d08ec452d9a532c278/users/cf3092d8143a4d3e9dd8d632aa0c00e5/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:28.370514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6c329-8835-4032-b0c5-bd4b2edbcd48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=905aba7a2b3642d08ec452d9a532c278, user_id=cf3092d8143a4d3e9dd8d632aa0c00e5, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:28.373404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6c329-8835-4032-b0c5-bd4b2edbcd48 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:28.377533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:28.391036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1074/2135] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:28 2022] PUT /identity/v3/projects/905aba7a2b3642d08ec452d9a532c278/users/cf3092d8143a4d3e9dd8d632aa0c00e5/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:28.402700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3927aa-20e3-4344-a888-d7fd93afbb43 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:28.403132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3927aa-20e3-4344-a888-d7fd93afbb43 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:28.403132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3927aa-20e3-4344-a888-d7fd93afbb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:28.450798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6e3927aa-20e3-4344-a888-d7fd93afbb43 None None] MFA Rules not processed for user `cf3092d8143a4d3e9dd8d632aa0c00e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:28.452182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6e3927aa-20e3-4344-a888-d7fd93afbb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:28.526498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1062/2136] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:28 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:28.531037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6c329-8835-4032-b0c5-bd4b2edbcd48 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:28.610218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6c329-8835-4032-b0c5-bd4b2edbcd48 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:28.614977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b3c87-5b0d-460b-a145-ae30e6b95585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:28.615626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b3c87-5b0d-460b-a145-ae30e6b95585 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:28.616035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b3c87-5b0d-460b-a145-ae30e6b95585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:28.616311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b3c87-5b0d-460b-a145-ae30e6b95585 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:28.616944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b3c87-5b0d-460b-a145-ae30e6b95585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:28.618864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b3c87-5b0d-460b-a145-ae30e6b95585 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:28.654778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1075/2137] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:28 2022] POST /identity/v3/projects => generated 409 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:28.659293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3927aa-20e3-4344-a888-d7fd93afbb43 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:28.673926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3927aa-20e3-4344-a888-d7fd93afbb43 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:28.710250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:28.743494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc9cd7-f841-4438-9050-1fa7ac3fcb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:28.744584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc9cd7-f841-4438-9050-1fa7ac3fcb53 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:28.745033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc9cd7-f841-4438-9050-1fa7ac3fcb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:28.745450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc9cd7-f841-4438-9050-1fa7ac3fcb53 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:28.746499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc9cd7-f841-4438-9050-1fa7ac3fcb53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:28.748711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc9cd7-f841-4438-9050-1fa7ac3fcb53 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:28.775276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1063/2138] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:28 2022] POST /identity/v3/users => generated 311 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:28.780074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b3c87-5b0d-460b-a145-ae30e6b95585 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:28.792086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b3c87-5b0d-460b-a145-ae30e6b95585 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:28.796699 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e3a7d-714a-44b7-8898-296bf7368b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:28.797479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3a7d-714a-44b7-8898-296bf7368b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:28.797768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3a7d-714a-44b7-8898-296bf7368b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:28.798043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3a7d-714a-44b7-8898-296bf7368b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:28.798693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e3a7d-714a-44b7-8898-296bf7368b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:28.800415 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e3a7d-714a-44b7-8898-296bf7368b8e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:28.813217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1076/2139] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:28.818297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc9cd7-f841-4438-9050-1fa7ac3fcb53 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:28.828839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc9cd7-f841-4438-9050-1fa7ac3fcb53 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:28.833795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917cc87-5f97-450e-9af7-cde2f004d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:28.834481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917cc87-5f97-450e-9af7-cde2f004d8df admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:28.834763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917cc87-5f97-450e-9af7-cde2f004d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:28.835642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917cc87-5f97-450e-9af7-cde2f004d8df admin admin] PATH_INFO: `/v3/projects/247e2949d93b417e80de6522172b12df/users/3c961143729441209d5b12686ec5c749/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:28.853037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917cc87-5f97-450e-9af7-cde2f004d8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=247e2949d93b417e80de6522172b12df, user_id=3c961143729441209d5b12686ec5c749, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:28.855821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917cc87-5f97-450e-9af7-cde2f004d8df admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:28.881957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1064/2140] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:28 2022] PUT /identity/v3/projects/247e2949d93b417e80de6522172b12df/users/3c961143729441209d5b12686ec5c749/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:28.886215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e3a7d-714a-44b7-8898-296bf7368b8e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:28.897198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e3a7d-714a-44b7-8898-296bf7368b8e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:28.967346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73587950-8883-454b-8df5-5b5015d8d61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:28.968946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73587950-8883-454b-8df5-5b5015d8d61f admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:28.969509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73587950-8883-454b-8df5-5b5015d8d61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:28.970001 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73587950-8883-454b-8df5-5b5015d8d61f admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:28.970907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73587950-8883-454b-8df5-5b5015d8d61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:28.972773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73587950-8883-454b-8df5-5b5015d8d61f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:28.991563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1077/2141] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:28.992047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917cc87-5f97-450e-9af7-cde2f004d8df admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:29.008049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917cc87-5f97-450e-9af7-cde2f004d8df admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:29.021471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a1fa-4a55-4294-ac03-0e213cf06c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:29.022716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a1fa-4a55-4294-ac03-0e213cf06c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:29.022716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a1fa-4a55-4294-ac03-0e213cf06c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:29.022900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a1fa-4a55-4294-ac03-0e213cf06c36 admin admin] PATH_INFO: `/v3/projects/247e2949d93b417e80de6522172b12df/users/3c961143729441209d5b12686ec5c749/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:29.025149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a1fa-4a55-4294-ac03-0e213cf06c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247e2949d93b417e80de6522172b12df, user_id=3c961143729441209d5b12686ec5c749, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:29.028316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a1fa-4a55-4294-ac03-0e213cf06c36 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:29.041602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1065/2142] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:28 2022] PUT /identity/v3/projects/247e2949d93b417e80de6522172b12df/users/3c961143729441209d5b12686ec5c749/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:29.051957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df85a38-80fb-4637-a935-540e8c486802 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:29.052469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df85a38-80fb-4637-a935-540e8c486802 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:29.052973 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df85a38-80fb-4637-a935-540e8c486802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:29.088473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8df85a38-80fb-4637-a935-540e8c486802 None None] MFA Rules not processed for user `3c961143729441209d5b12686ec5c749`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:29.089769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8df85a38-80fb-4637-a935-540e8c486802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:29.202671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:29.212979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a1fa-4a55-4294-ac03-0e213cf06c36 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:29.215402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ecd0a1fa-4a55-4294-ac03-0e213cf06c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:29.229650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1078/2143] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:29.288547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a1fa-4a55-4294-ac03-0e213cf06c36 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:29.293634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256768f-b7c0-4920-a727-e392a7b4601b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:29.295085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256768f-b7c0-4920-a727-e392a7b4601b service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:29.295480 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256768f-b7c0-4920-a727-e392a7b4601b service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:29.295763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256768f-b7c0-4920-a727-e392a7b4601b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:29.297754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9256768f-b7c0-4920-a727-e392a7b4601b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:29.337372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df85a38-80fb-4637-a935-540e8c486802 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:29.339209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8df85a38-80fb-4637-a935-540e8c486802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:29.352927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df85a38-80fb-4637-a935-540e8c486802 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:29.356837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb474a2-80a0-4093-93c3-5c09b3d3f65b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:29.357449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb474a2-80a0-4093-93c3-5c09b3d3f65b service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:29.357723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb474a2-80a0-4093-93c3-5c09b3d3f65b service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:29.357993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb474a2-80a0-4093-93c3-5c09b3d3f65b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:29.367522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb474a2-80a0-4093-93c3-5c09b3d3f65b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:29.368960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb474a2-80a0-4093-93c3-5c09b3d3f65b service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:29.374633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256768f-b7c0-4920-a727-e392a7b4601b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:29.376407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256768f-b7c0-4920-a727-e392a7b4601b service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:29.378776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1079/2144] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:29 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:29.388793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1066/2145] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:29.840008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb474a2-80a0-4093-93c3-5c09b3d3f65b service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:29.852650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb474a2-80a0-4093-93c3-5c09b3d3f65b service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:29.859551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd3a77-74ff-4760-a0f0-997c1d795464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:29.861040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd3a77-74ff-4760-a0f0-997c1d795464 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:29.861501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd3a77-74ff-4760-a0f0-997c1d795464 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:29.861860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd3a77-74ff-4760-a0f0-997c1d795464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:29.929987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd3a77-74ff-4760-a0f0-997c1d795464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:29.931064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd3a77-74ff-4760-a0f0-997c1d795464 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:29.941906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1080/2146] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:29 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:30.063751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256768f-b7c0-4920-a727-e392a7b4601b service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:30.065966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9256768f-b7c0-4920-a727-e392a7b4601b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:30.103346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd3a77-74ff-4760-a0f0-997c1d795464 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:30.105674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9dcd3a77-74ff-4760-a0f0-997c1d795464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:30.165354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:30.212617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256768f-b7c0-4920-a727-e392a7b4601b service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:30.217692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:30.218699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:30.219006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:30.219276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] PATH_INFO: `/v3/users/dcc334bad2ec480b8d355742b730f008` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:30.220512 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc334bad2ec480b8d355742b730f008)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:30.222679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:30.283587 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd3a77-74ff-4760-a0f0-997c1d795464 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:30.291030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:30.292012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:30.292364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:30.298753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] PATH_INFO: `/v3/users/f6141216ae1c472ea7f7195ac18d4849` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:30.312158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6141216ae1c472ea7f7195ac18d4849)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:30.314178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:30.322020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc334bad2ec480b8d355742b730f008'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:30.341903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc334bad2ec480b8d355742b730f008'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:30.360988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc334bad2ec480b8d355742b730f008'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:30.362745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc334bad2ec480b8d355742b730f008'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:30.363891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-706c740b-f1e8-4d3f-83a9-dc98bb7dc048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc334bad2ec480b8d355742b730f008'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:30.397782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1067/2147] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:30 2022] DELETE /identity/v3/users/dcc334bad2ec480b8d355742b730f008 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:30.399541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411a794-039e-414d-8b5f-f9ac0481632e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:30.399828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411a794-039e-414d-8b5f-f9ac0481632e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:30.400111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411a794-039e-414d-8b5f-f9ac0481632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:30.437827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4411a794-039e-414d-8b5f-f9ac0481632e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:30.442496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4411a794-039e-414d-8b5f-f9ac0481632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:30.452064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6141216ae1c472ea7f7195ac18d4849'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:30.479695 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6141216ae1c472ea7f7195ac18d4849'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:30.499612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6141216ae1c472ea7f7195ac18d4849'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:30.500918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6141216ae1c472ea7f7195ac18d4849'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:30.501892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6141216ae1c472ea7f7195ac18d4849'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:30.512086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:30.530964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1081/2148] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:30 2022] DELETE /identity/v3/users/f6141216ae1c472ea7f7195ac18d4849 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:30.532116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:30.537345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:30.622016 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1068/2149] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:30.623773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36b19a-dc08-4e0e-87a5-a0e11a1cfd5a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:30.625271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36b19a-dc08-4e0e-87a5-a0e11a1cfd5a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:30.625555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36b19a-dc08-4e0e-87a5-a0e11a1cfd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:30.656390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5f36b19a-dc08-4e0e-87a5-a0e11a1cfd5a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:30.657678 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5f36b19a-dc08-4e0e-87a5-a0e11a1cfd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:30.675344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2044d1-a3a0-46b9-995a-ec89e71d8b10 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:30.680509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62640d0e-7f93-4c92-aa77-c5fa6c144b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:30.681839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62640d0e-7f93-4c92-aa77-c5fa6c144b41 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:30.682626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62640d0e-7f93-4c92-aa77-c5fa6c144b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:30.682804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62640d0e-7f93-4c92-aa77-c5fa6c144b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:30.685517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-62640d0e-7f93-4c92-aa77-c5fa6c144b41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:30.735882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:30.747593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1069/2150] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:30.749152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36b19a-dc08-4e0e-87a5-a0e11a1cfd5a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:30.753483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5f36b19a-dc08-4e0e-87a5-a0e11a1cfd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:30.793758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62640d0e-7f93-4c92-aa77-c5fa6c144b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:30.796120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62640d0e-7f93-4c92-aa77-c5fa6c144b41 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:30.810309 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1082/2151] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:30.811216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62640d0e-7f93-4c92-aa77-c5fa6c144b41 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:30.813262 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-62640d0e-7f93-4c92-aa77-c5fa6c144b41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:30.848203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36b19a-dc08-4e0e-87a5-a0e11a1cfd5a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:30.856112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa5bc-4a46-4926-9161-157b861ab2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:30.856889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa5bc-4a46-4926-9161-157b861ab2cf service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:30.857235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa5bc-4a46-4926-9161-157b861ab2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:30.857577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa5bc-4a46-4926-9161-157b861ab2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:30.879950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa5bc-4a46-4926-9161-157b861ab2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:30.881427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa5bc-4a46-4926-9161-157b861ab2cf service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:30.892251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62640d0e-7f93-4c92-aa77-c5fa6c144b41 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:30.899498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48ef43-9bcf-4001-9a8c-aa97d49e8dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:30.901083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48ef43-9bcf-4001-9a8c-aa97d49e8dad service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:30.901437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48ef43-9bcf-4001-9a8c-aa97d49e8dad service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:30.901804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48ef43-9bcf-4001-9a8c-aa97d49e8dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:30.910091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1070/2152] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:30.914166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48ef43-9bcf-4001-9a8c-aa97d49e8dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:30.916633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48ef43-9bcf-4001-9a8c-aa97d49e8dad service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:30.932223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1083/2153] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:31.200092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2079a-b83a-498c-b82e-945ea1521fcc None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:31.200538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2079a-b83a-498c-b82e-945ea1521fcc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:31.200711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2079a-b83a-498c-b82e-945ea1521fcc None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:31.202300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1071/2154] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:23:31.249548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8dcf-5930-4d9d-a045-29b80d0346b5 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:31.249548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8dcf-5930-4d9d-a045-29b80d0346b5 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:31.249548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8dcf-5930-4d9d-a045-29b80d0346b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:31.275662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-873b8dcf-5930-4d9d-a045-29b80d0346b5 None None] MFA Rules not processed for user `bac171ccd62b4c268e79a318478414ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:31.277114 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-873b8dcf-5930-4d9d-a045-29b80d0346b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:31.312243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2079a-b83a-498c-b82e-945ea1521fcc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:31.314378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-84a2079a-b83a-498c-b82e-945ea1521fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:31.339013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:31.355339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2079a-b83a-498c-b82e-945ea1521fcc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:31.362311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:31.363197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:31.363853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:31.364571 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] PATH_INFO: `/v3/users/07f4d63ddeee4badb517ce829f816fad` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:31.366313 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f4d63ddeee4badb517ce829f816fad)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:31.368491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:31.375707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1084/2155] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:31.376656 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b8dcf-5930-4d9d-a045-29b80d0346b5 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:31.380294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-873b8dcf-5930-4d9d-a045-29b80d0346b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:31.414058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b8dcf-5930-4d9d-a045-29b80d0346b5 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:31.420389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:31.422760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:31.423151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:31.423575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] PATH_INFO: `/v3/projects/7305f00e930244cbb2dfe3bcb95ad59d` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:31.425220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7305f00e930244cbb2dfe3bcb95ad59d)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:31.428141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:31.429813 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f4d63ddeee4badb517ce829f816fad'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.446377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f4d63ddeee4badb517ce829f816fad'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.454009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f4d63ddeee4badb517ce829f816fad'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.454942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f4d63ddeee4badb517ce829f816fad'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.455706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2504164a-78d3-452d-985e-2706d3526878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f4d63ddeee4badb517ce829f816fad'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.478517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1072/2156] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:31 2022] DELETE /identity/v3/users/07f4d63ddeee4badb517ce829f816fad => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:31.480160 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0336c-b0da-4a5c-8e9e-1847c0e71d5a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:31.480523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0336c-b0da-4a5c-8e9e-1847c0e71d5a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:31.480898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0336c-b0da-4a5c-8e9e-1847c0e71d5a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:31.482800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1073/2157] 10.222.0.39 () {54 vars in 961 bytes} [Sat Sep 3 01:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:23:31.483576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0336c-b0da-4a5c-8e9e-1847c0e71d5a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:31.485633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cfb0336c-b0da-4a5c-8e9e-1847c0e71d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:31.491937 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7305f00e930244cbb2dfe3bcb95ad59d', 'request_id': 'req-e3931951-67c5-4a9e-ba38-a7d819d88c62'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.505304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7305f00e930244cbb2dfe3bcb95ad59d', 'request_id': 'req-e3931951-67c5-4a9e-ba38-a7d819d88c62'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.515637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7305f00e930244cbb2dfe3bcb95ad59d', 'request_id': 'req-e3931951-67c5-4a9e-ba38-a7d819d88c62'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.529438 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] The token cache is being invalidate because project 7305f00e930244cbb2dfe3bcb95ad59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:31.529795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.530411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e3931951-67c5-4a9e-ba38-a7d819d88c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.532305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1085/2158] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:31 2022] DELETE /identity/v3/projects/7305f00e930244cbb2dfe3bcb95ad59d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:31.533514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f54f-ef33-4c23-be57-9afee13b0b0d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:31.533798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f54f-ef33-4c23-be57-9afee13b0b0d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:31.534072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f54f-ef33-4c23-be57-9afee13b0b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:31.567501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-dc00f54f-ef33-4c23-be57-9afee13b0b0d None None] MFA Rules not processed for user `bac171ccd62b4c268e79a318478414ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:31.568717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-dc00f54f-ef33-4c23-be57-9afee13b0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:31.605659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0336c-b0da-4a5c-8e9e-1847c0e71d5a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:31.617559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:31.618128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:31.618382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:31.618660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] PATH_INFO: `/v3/projects/3c811c77f0c44fc097574e2d2872af05` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:31.622165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c811c77f0c44fc097574e2d2872af05)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:31.629689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:31.682055 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:31.764055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1086/2159] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Sep 3 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:31.765241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f54f-ef33-4c23-be57-9afee13b0b0d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:31.773158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-dc00f54f-ef33-4c23-be57-9afee13b0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:31.774737 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c811c77f0c44fc097574e2d2872af05', 'request_id': 'req-228546c3-4925-46ca-aa18-b50b86b765cf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.793182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c811c77f0c44fc097574e2d2872af05', 'request_id': 'req-228546c3-4925-46ca-aa18-b50b86b765cf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.807181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c811c77f0c44fc097574e2d2872af05', 'request_id': 'req-228546c3-4925-46ca-aa18-b50b86b765cf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.807647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f54f-ef33-4c23-be57-9afee13b0b0d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:31.830897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] The token cache is being invalidate because project 3c811c77f0c44fc097574e2d2872af05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:31.831790 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.832878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.835300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1074/2160] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:31 2022] DELETE /identity/v3/projects/3c811c77f0c44fc097574e2d2872af05 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:31.836686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:31.840005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:31.895519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:31.896271 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:31.896555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:31.896827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] PATH_INFO: `/v3/projects/accaf63f55e149aea52750361429e68a` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:31.898125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accaf63f55e149aea52750361429e68a)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:31.900446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:31.908308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:31.936304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228546c3-4925-46ca-aa18-b50b86b765cf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:31.944083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc86f03-7f2b-45b5-b02a-7232f7b7b66f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:31.944977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc86f03-7f2b-45b5-b02a-7232f7b7b66f service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:31.945314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc86f03-7f2b-45b5-b02a-7232f7b7b66f service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:31.945649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc86f03-7f2b-45b5-b02a-7232f7b7b66f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:31.947723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cdc86f03-7f2b-45b5-b02a-7232f7b7b66f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:31.960117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accaf63f55e149aea52750361429e68a', 'request_id': 'req-a3d1ddf1-31a5-4005-bf10-19509961a709'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.968329 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc86f03-7f2b-45b5-b02a-7232f7b7b66f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:31.970207 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc86f03-7f2b-45b5-b02a-7232f7b7b66f service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:31.974259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accaf63f55e149aea52750361429e68a', 'request_id': 'req-a3d1ddf1-31a5-4005-bf10-19509961a709'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.980299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accaf63f55e149aea52750361429e68a', 'request_id': 'req-a3d1ddf1-31a5-4005-bf10-19509961a709'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:31.986771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1075/2161] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:31.988476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc86f03-7f2b-45b5-b02a-7232f7b7b66f service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:31.995389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cdc86f03-7f2b-45b5-b02a-7232f7b7b66f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:32.011312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] The token cache is being invalidate because project accaf63f55e149aea52750361429e68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:32.013439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.013439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a3d1ddf1-31a5-4005-bf10-19509961a709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.034319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1087/2162] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:31 2022] DELETE /identity/v3/projects/accaf63f55e149aea52750361429e68a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:32.036145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f56e4-1f95-4a1e-b9f4-84844cdbfc2d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.036812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f56e4-1f95-4a1e-b9f4-84844cdbfc2d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.037149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f56e4-1f95-4a1e-b9f4-84844cdbfc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.037781 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc86f03-7f2b-45b5-b02a-7232f7b7b66f service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.074688 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3f9f56e4-1f95-4a1e-b9f4-84844cdbfc2d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:32.076210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3f9f56e4-1f95-4a1e-b9f4-84844cdbfc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:32.127458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.128108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.128391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.128728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] PATH_INFO: `/v3/users/2d46f8dd61154591829fc611253a8fa8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.130197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d46f8dd61154591829fc611253a8fa8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.132318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.144538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1088/2163] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:32.152193 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c412945-2500-44e2-841a-e5cd839fab21 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.152480 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c412945-2500-44e2-841a-e5cd839fab21 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.152755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c412945-2500-44e2-841a-e5cd839fab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.173023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2c412945-2500-44e2-841a-e5cd839fab21 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:32.174298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2c412945-2500-44e2-841a-e5cd839fab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:32.186089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1089/2164] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:32.191968 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c412945-2500-44e2-841a-e5cd839fab21 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.198828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:32.207520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c412945-2500-44e2-841a-e5cd839fab21 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.212165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d46f8dd61154591829fc611253a8fa8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.213366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349d23c-83ee-4a7d-b174-8d1967afd277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.214036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349d23c-83ee-4a7d-b174-8d1967afd277 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.214330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349d23c-83ee-4a7d-b174-8d1967afd277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.214601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349d23c-83ee-4a7d-b174-8d1967afd277 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.215329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349d23c-83ee-4a7d-b174-8d1967afd277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:32.215643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349d23c-83ee-4a7d-b174-8d1967afd277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.217261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349d23c-83ee-4a7d-b174-8d1967afd277 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.231003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1090/2165] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:32.235531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349d23c-83ee-4a7d-b174-8d1967afd277 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.238573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d46f8dd61154591829fc611253a8fa8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.247608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d46f8dd61154591829fc611253a8fa8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.247943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349d23c-83ee-4a7d-b174-8d1967afd277 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.248344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d46f8dd61154591829fc611253a8fa8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.248957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d46f8dd61154591829fc611253a8fa8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.253420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83801e-b16b-4859-ab89-6c8b4339072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.254036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83801e-b16b-4859-ab89-6c8b4339072d admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.254306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83801e-b16b-4859-ab89-6c8b4339072d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.254569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83801e-b16b-4859-ab89-6c8b4339072d admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.255193 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83801e-b16b-4859-ab89-6c8b4339072d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.257196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83801e-b16b-4859-ab89-6c8b4339072d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.267335 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1076/2166] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:31 2022] DELETE /identity/v3/users/2d46f8dd61154591829fc611253a8fa8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:32.298153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1091/2167] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:32 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:32.302546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.304175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:32.379233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96df72-bff0-4462-83e9-6ba0b915ce7d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.452879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fe14f-6747-4790-8854-c3e555213d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.453347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fe14f-6747-4790-8854-c3e555213d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.453854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fe14f-6747-4790-8854-c3e555213d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.454226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fe14f-6747-4790-8854-c3e555213d30 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.454943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fe14f-6747-4790-8854-c3e555213d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.457009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fe14f-6747-4790-8854-c3e555213d30 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.487293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1077/2168] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:32 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:32.490559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83801e-b16b-4859-ab89-6c8b4339072d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.501934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83801e-b16b-4859-ab89-6c8b4339072d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.506454 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ded3d-1db5-4b19-bbb7-77c0a0074a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.507056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ded3d-1db5-4b19-bbb7-77c0a0074a48 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.507389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ded3d-1db5-4b19-bbb7-77c0a0074a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.507661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ded3d-1db5-4b19-bbb7-77c0a0074a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.508304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ded3d-1db5-4b19-bbb7-77c0a0074a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.510156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ded3d-1db5-4b19-bbb7-77c0a0074a48 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.520627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1092/2169] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:32.524975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fe14f-6747-4790-8854-c3e555213d30 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.536305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fe14f-6747-4790-8854-c3e555213d30 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.541064 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233e57f-a26a-4fd4-9897-9937032afd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.541853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233e57f-a26a-4fd4-9897-9937032afd7b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.542130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233e57f-a26a-4fd4-9897-9937032afd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.542428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233e57f-a26a-4fd4-9897-9937032afd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.543075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233e57f-a26a-4fd4-9897-9937032afd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.544763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233e57f-a26a-4fd4-9897-9937032afd7b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.559179 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1078/2170] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:32.561181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ded3d-1db5-4b19-bbb7-77c0a0074a48 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.571364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ded3d-1db5-4b19-bbb7-77c0a0074a48 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.576148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f0d33-4294-408d-a62a-d2aaf15c35a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.576804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0d33-4294-408d-a62a-d2aaf15c35a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.577079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0d33-4294-408d-a62a-d2aaf15c35a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.577532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0d33-4294-408d-a62a-d2aaf15c35a4 admin admin] PATH_INFO: `/v3/projects/70423e023e344254a30823d49077937e/users/2b73ee04318147fe923c80760c3b6cf8/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.580376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233e57f-a26a-4fd4-9897-9937032afd7b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.582175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2233e57f-a26a-4fd4-9897-9937032afd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:32.597332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f0d33-4294-408d-a62a-d2aaf15c35a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70423e023e344254a30823d49077937e, user_id=2b73ee04318147fe923c80760c3b6cf8, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.600428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f0d33-4294-408d-a62a-d2aaf15c35a4 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.606485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233e57f-a26a-4fd4-9897-9937032afd7b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.615240 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1093/2171] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:32 2022] PUT /identity/v3/projects/70423e023e344254a30823d49077937e/users/2b73ee04318147fe923c80760c3b6cf8/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:32.617633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.618292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.618654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.618853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] PATH_INFO: `/v3/projects/fbe11096e5334190a2b733610a3757e9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.620102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe11096e5334190a2b733610a3757e9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.620979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396dec9-be60-4b32-a634-b96c5025712d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.621441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396dec9-be60-4b32-a634-b96c5025712d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.621949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396dec9-be60-4b32-a634-b96c5025712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.622482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.642522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5396dec9-be60-4b32-a634-b96c5025712d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:32.643980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5396dec9-be60-4b32-a634-b96c5025712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:32.659214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:32.664202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:32.677273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe11096e5334190a2b733610a3757e9', 'request_id': 'req-b01a133a-bac5-4c6b-a11e-e6c81f167e99'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.685506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe11096e5334190a2b733610a3757e9', 'request_id': 'req-b01a133a-bac5-4c6b-a11e-e6c81f167e99'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.692700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe11096e5334190a2b733610a3757e9', 'request_id': 'req-b01a133a-bac5-4c6b-a11e-e6c81f167e99'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.703270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] The token cache is being invalidate because project fbe11096e5334190a2b733610a3757e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:32.703641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.704284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b01a133a-bac5-4c6b-a11e-e6c81f167e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:32.705780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1079/2172] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:32 2022] DELETE /identity/v3/projects/fbe11096e5334190a2b733610a3757e9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:32.710477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22414946-e317-41d8-8f50-0d0d3aafe3ca None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.710759 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22414946-e317-41d8-8f50-0d0d3aafe3ca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.711031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22414946-e317-41d8-8f50-0d0d3aafe3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.712686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1094/2173] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:32.722719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396dec9-be60-4b32-a634-b96c5025712d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.724276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5396dec9-be60-4b32-a634-b96c5025712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:32.731603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-22414946-e317-41d8-8f50-0d0d3aafe3ca None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:32.732836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-22414946-e317-41d8-8f50-0d0d3aafe3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:32.785618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396dec9-be60-4b32-a634-b96c5025712d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.793645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1080/2174] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:32.801291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ceca-b945-4d57-9e65-d7546feec1bd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.801580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ceca-b945-4d57-9e65-d7546feec1bd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.801857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ceca-b945-4d57-9e65-d7546feec1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.822054 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8861ceca-b945-4d57-9e65-d7546feec1bd None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:32.823497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8861ceca-b945-4d57-9e65-d7546feec1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:32.832538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1081/2175] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:32.836740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861ceca-b945-4d57-9e65-d7546feec1bd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.842310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05b4f7-5ea1-4e41-9cb4-73996d248af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.842936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05b4f7-5ea1-4e41-9cb4-73996d248af8 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.843242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05b4f7-5ea1-4e41-9cb4-73996d248af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.843543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05b4f7-5ea1-4e41-9cb4-73996d248af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.846901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861ceca-b945-4d57-9e65-d7546feec1bd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.852611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003873f-7de2-43f3-a08c-9c016d9254e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.853492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003873f-7de2-43f3-a08c-9c016d9254e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.853795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003873f-7de2-43f3-a08c-9c016d9254e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.853914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05b4f7-5ea1-4e41-9cb4-73996d248af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.854111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003873f-7de2-43f3-a08c-9c016d9254e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.854821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003873f-7de2-43f3-a08c-9c016d9254e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:32.855123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003873f-7de2-43f3-a08c-9c016d9254e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.855406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05b4f7-5ea1-4e41-9cb4-73996d248af8 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.856790 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003873f-7de2-43f3-a08c-9c016d9254e2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.865625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1095/2176] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:32.869355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1082/2177] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:23:32.873624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05b4f7-5ea1-4e41-9cb4-73996d248af8 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.882944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05b4f7-5ea1-4e41-9cb4-73996d248af8 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.887807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18ebc-6997-4c89-8ba0-cd78f529431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.888404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18ebc-6997-4c89-8ba0-cd78f529431e admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.888815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18ebc-6997-4c89-8ba0-cd78f529431e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.888933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18ebc-6997-4c89-8ba0-cd78f529431e admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.889549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b18ebc-6997-4c89-8ba0-cd78f529431e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.891501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b18ebc-6997-4c89-8ba0-cd78f529431e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:32.923177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1096/2178] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:32 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:32.924379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003873f-7de2-43f3-a08c-9c016d9254e2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:32.935184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003873f-7de2-43f3-a08c-9c016d9254e2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:32.995155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3d1a8-21ec-43db-a3d4-2db01d874d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:32.995883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d1a8-21ec-43db-a3d4-2db01d874d7e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:32.996165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d1a8-21ec-43db-a3d4-2db01d874d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:32.996436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d1a8-21ec-43db-a3d4-2db01d874d7e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:32.997075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3d1a8-21ec-43db-a3d4-2db01d874d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:32.999018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3d1a8-21ec-43db-a3d4-2db01d874d7e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:33.023282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1083/2179] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:32 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:33.027610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18ebc-6997-4c89-8ba0-cd78f529431e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:33.038586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18ebc-6997-4c89-8ba0-cd78f529431e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:33.044727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e18b1-6a4c-474e-96e3-98b6e6652caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:33.045370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e18b1-6a4c-474e-96e3-98b6e6652caa admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:33.045708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e18b1-6a4c-474e-96e3-98b6e6652caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:33.046041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e18b1-6a4c-474e-96e3-98b6e6652caa admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:33.046903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e18b1-6a4c-474e-96e3-98b6e6652caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:33.048814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e18b1-6a4c-474e-96e3-98b6e6652caa admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:33.060349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1097/2180] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:33.064258 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3d1a8-21ec-43db-a3d4-2db01d874d7e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:33.075808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3d1a8-21ec-43db-a3d4-2db01d874d7e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:33.080347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e408987-535c-4d05-adbb-c826c34fc2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:33.080970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408987-535c-4d05-adbb-c826c34fc2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:33.081367 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408987-535c-4d05-adbb-c826c34fc2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:33.081569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408987-535c-4d05-adbb-c826c34fc2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:33.082221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e408987-535c-4d05-adbb-c826c34fc2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:33.083903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e408987-535c-4d05-adbb-c826c34fc2a5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:33.096856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1084/2181] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:33.102276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e18b1-6a4c-474e-96e3-98b6e6652caa admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:33.117536 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e18b1-6a4c-474e-96e3-98b6e6652caa admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:33.126994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c92b-7f5a-4029-9e1d-33416db2931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:33.127992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c92b-7f5a-4029-9e1d-33416db2931f admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:33.128418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c92b-7f5a-4029-9e1d-33416db2931f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:33.128689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c92b-7f5a-4029-9e1d-33416db2931f admin admin] PATH_INFO: `/v3/projects/ef7d62b3a9534abc9dd13e653fef47f1/users/dff42ca3053145e38e7128a37448a904/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:33.151637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53c92b-7f5a-4029-9e1d-33416db2931f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7d62b3a9534abc9dd13e653fef47f1, user_id=dff42ca3053145e38e7128a37448a904, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:33.156292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53c92b-7f5a-4029-9e1d-33416db2931f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:33.198482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1098/2182] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:33 2022] PUT /identity/v3/projects/ef7d62b3a9534abc9dd13e653fef47f1/users/dff42ca3053145e38e7128a37448a904/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:33.202857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65764471-fe9e-4575-b305-39a49fd768a8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:33.203142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65764471-fe9e-4575-b305-39a49fd768a8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:33.203444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65764471-fe9e-4575-b305-39a49fd768a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:33.253690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-65764471-fe9e-4575-b305-39a49fd768a8 None None] MFA Rules not processed for user `dff42ca3053145e38e7128a37448a904`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:33.256399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-65764471-fe9e-4575-b305-39a49fd768a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:33.283717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:33.378030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1085/2183] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:33.383081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c92b-7f5a-4029-9e1d-33416db2931f admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:33.407207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:33.459289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c92b-7f5a-4029-9e1d-33416db2931f admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:33.464354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea16b-fae7-4a6e-85dd-029ffd6378f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:33.464979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea16b-fae7-4a6e-85dd-029ffd6378f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:33.465263 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea16b-fae7-4a6e-85dd-029ffd6378f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:33.465807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea16b-fae7-4a6e-85dd-029ffd6378f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:33.466457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcea16b-fae7-4a6e-85dd-029ffd6378f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:33.468431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcea16b-fae7-4a6e-85dd-029ffd6378f2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:33.507452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1099/2184] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:33 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:33.511869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65764471-fe9e-4575-b305-39a49fd768a8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:33.532955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65764471-fe9e-4575-b305-39a49fd768a8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:33.638442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6d86-364e-4a61-b928-926afd0f0411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:33.639105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6d86-364e-4a61-b928-926afd0f0411 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:33.639437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6d86-364e-4a61-b928-926afd0f0411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:33.639727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6d86-364e-4a61-b928-926afd0f0411 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:33.640365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc6d86-364e-4a61-b928-926afd0f0411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:33.642304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc6d86-364e-4a61-b928-926afd0f0411 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:33.675318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1086/2185] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:33 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:33.678976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea16b-fae7-4a6e-85dd-029ffd6378f2 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:33.692384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea16b-fae7-4a6e-85dd-029ffd6378f2 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:33.697946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805bfd3-dda9-4777-b2ea-c07034ebd5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:33.698533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805bfd3-dda9-4777-b2ea-c07034ebd5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:33.698704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805bfd3-dda9-4777-b2ea-c07034ebd5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:33.698916 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805bfd3-dda9-4777-b2ea-c07034ebd5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:33.699793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805bfd3-dda9-4777-b2ea-c07034ebd5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:33.701667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805bfd3-dda9-4777-b2ea-c07034ebd5f0 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:33.725979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1100/2186] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:33.727448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6d86-364e-4a61-b928-926afd0f0411 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:33.742758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6d86-364e-4a61-b928-926afd0f0411 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:33.748316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473594-c649-4f14-8127-ea58132769f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:33.749037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473594-c649-4f14-8127-ea58132769f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:33.749321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473594-c649-4f14-8127-ea58132769f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:33.750243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473594-c649-4f14-8127-ea58132769f6 admin admin] PATH_INFO: `/v3/projects/119e523611fe423db60159d83031d3ea/users/f4aaba3bbb7541cfba3ec19b8985c1c9/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:33.781588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9473594-c649-4f14-8127-ea58132769f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119e523611fe423db60159d83031d3ea, user_id=f4aaba3bbb7541cfba3ec19b8985c1c9, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:33.788174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9473594-c649-4f14-8127-ea58132769f6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:33.833842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1087/2187] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:33 2022] PUT /identity/v3/projects/119e523611fe423db60159d83031d3ea/users/f4aaba3bbb7541cfba3ec19b8985c1c9/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:33.838883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805bfd3-dda9-4777-b2ea-c07034ebd5f0 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:33.866802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805bfd3-dda9-4777-b2ea-c07034ebd5f0 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:33.979999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a1af8-3dc2-4dc8-aa62-b5d7a9ce05ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:33.981121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a1af8-3dc2-4dc8-aa62-b5d7a9ce05ce admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:33.981416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a1af8-3dc2-4dc8-aa62-b5d7a9ce05ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:33.981691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a1af8-3dc2-4dc8-aa62-b5d7a9ce05ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:33.982744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a1af8-3dc2-4dc8-aa62-b5d7a9ce05ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:33.985132 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a1af8-3dc2-4dc8-aa62-b5d7a9ce05ce admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:34.010296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1101/2188] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:34.014535 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473594-c649-4f14-8127-ea58132769f6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:34.029801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473594-c649-4f14-8127-ea58132769f6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:34.035195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305338b-3aa1-40c4-8e65-4820d0d77260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:34.035957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305338b-3aa1-40c4-8e65-4820d0d77260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:34.036243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305338b-3aa1-40c4-8e65-4820d0d77260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:34.036518 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305338b-3aa1-40c4-8e65-4820d0d77260 admin admin] PATH_INFO: `/v3/projects/119e523611fe423db60159d83031d3ea/users/f4aaba3bbb7541cfba3ec19b8985c1c9/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:34.039047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305338b-3aa1-40c4-8e65-4820d0d77260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119e523611fe423db60159d83031d3ea, user_id=f4aaba3bbb7541cfba3ec19b8985c1c9, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:34.042793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305338b-3aa1-40c4-8e65-4820d0d77260 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:34.067081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1088/2189] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:34 2022] PUT /identity/v3/projects/119e523611fe423db60159d83031d3ea/users/f4aaba3bbb7541cfba3ec19b8985c1c9/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:34.068839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47732ca-6c3e-4c6b-ab94-96c9d4428fc9 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:34.069325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47732ca-6c3e-4c6b-ab94-96c9d4428fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:34.069789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47732ca-6c3e-4c6b-ab94-96c9d4428fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:34.107846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-c47732ca-6c3e-4c6b-ab94-96c9d4428fc9 None None] MFA Rules not processed for user `f4aaba3bbb7541cfba3ec19b8985c1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:34.109983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c47732ca-6c3e-4c6b-ab94-96c9d4428fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:34.218908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1102/2190] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:34.228159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305338b-3aa1-40c4-8e65-4820d0d77260 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:34.230508 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e305338b-3aa1-40c4-8e65-4820d0d77260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:34.302449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305338b-3aa1-40c4-8e65-4820d0d77260 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:34.306205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eade7bb-8b83-44ca-8c8e-38b1ab2a6e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:34.307070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eade7bb-8b83-44ca-8c8e-38b1ab2a6e9d service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:34.307446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eade7bb-8b83-44ca-8c8e-38b1ab2a6e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:34.307798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eade7bb-8b83-44ca-8c8e-38b1ab2a6e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:34.320827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eade7bb-8b83-44ca-8c8e-38b1ab2a6e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:34.322247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eade7bb-8b83-44ca-8c8e-38b1ab2a6e9d service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:34.335354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1089/2191] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:34.962177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47732ca-6c3e-4c6b-ab94-96c9d4428fc9 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:34.989719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:35.108502 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47732ca-6c3e-4c6b-ab94-96c9d4428fc9 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:35.128354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eade7bb-8b83-44ca-8c8e-38b1ab2a6e9d service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:35.140331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:35.140996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:35.141274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:35.141597 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] PATH_INFO: `/v3/users/dff42ca3053145e38e7128a37448a904` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:35.144289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff42ca3053145e38e7128a37448a904)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:35.147212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6eade7bb-8b83-44ca-8c8e-38b1ab2a6e9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:35.147460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:35.188181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eade7bb-8b83-44ca-8c8e-38b1ab2a6e9d service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:35.197712 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:35.198755 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:35.199353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:35.199770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] PATH_INFO: `/v3/users/5147e5b03d8a4c2ebe7504ada4a5d038` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:35.201448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5147e5b03d8a4c2ebe7504ada4a5d038)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:35.204096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:35.207043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:35.239724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff42ca3053145e38e7128a37448a904'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:35.256440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff42ca3053145e38e7128a37448a904'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:35.276771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff42ca3053145e38e7128a37448a904'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:35.277743 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff42ca3053145e38e7128a37448a904'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:35.278585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-ed24f076-6978-4c56-9419-852cba948229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff42ca3053145e38e7128a37448a904'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:35.298880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1103/2192] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:34 2022] DELETE /identity/v3/users/dff42ca3053145e38e7128a37448a904 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:35.304700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179278b0-eb40-4e8e-bc94-37ea5041d931 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:35.305012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179278b0-eb40-4e8e-bc94-37ea5041d931 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:35.305696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179278b0-eb40-4e8e-bc94-37ea5041d931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:35.312289 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5147e5b03d8a4c2ebe7504ada4a5d038'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:35.328474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5147e5b03d8a4c2ebe7504ada4a5d038'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:35.332994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-179278b0-eb40-4e8e-bc94-37ea5041d931 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:35.334089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-179278b0-eb40-4e8e-bc94-37ea5041d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:35.338243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5147e5b03d8a4c2ebe7504ada4a5d038'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:35.339242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5147e5b03d8a4c2ebe7504ada4a5d038'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:35.340092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92999104-d713-41c1-b280-0ccb2e1de2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5147e5b03d8a4c2ebe7504ada4a5d038'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:35.360943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1090/2193] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:35 2022] DELETE /identity/v3/users/5147e5b03d8a4c2ebe7504ada4a5d038 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:35.365651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32821756-a7b1-4e99-90d2-90b2bc48aaca None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:35.367305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32821756-a7b1-4e99-90d2-90b2bc48aaca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:35.367814 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32821756-a7b1-4e99-90d2-90b2bc48aaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:35.395567 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-32821756-a7b1-4e99-90d2-90b2bc48aaca None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:35.396937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-32821756-a7b1-4e99-90d2-90b2bc48aaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:35.411042 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1104/2194] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:35.420851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179278b0-eb40-4e8e-bc94-37ea5041d931 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:35.422207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-179278b0-eb40-4e8e-bc94-37ea5041d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:35.462457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1091/2195] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:35.473364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32821756-a7b1-4e99-90d2-90b2bc48aaca None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:35.474534 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:35.476350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-32821756-a7b1-4e99-90d2-90b2bc48aaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:35.498910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179278b0-eb40-4e8e-bc94-37ea5041d931 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:35.549507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349395e-bacd-4675-989c-9e96d11e236e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:35.550919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349395e-bacd-4675-989c-9e96d11e236e service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:35.551381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32821756-a7b1-4e99-90d2-90b2bc48aaca None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:35.551579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349395e-bacd-4675-989c-9e96d11e236e service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:35.551953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349395e-bacd-4675-989c-9e96d11e236e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:35.555888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c06fb-4b0c-4779-b0b6-f5af12d33d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:35.556668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c06fb-4b0c-4779-b0b6-f5af12d33d65 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:35.556940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c06fb-4b0c-4779-b0b6-f5af12d33d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:35.557213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c06fb-4b0c-4779-b0b6-f5af12d33d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:35.562887 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349395e-bacd-4675-989c-9e96d11e236e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:35.564511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349395e-bacd-4675-989c-9e96d11e236e service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:35.567209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c06fb-4b0c-4779-b0b6-f5af12d33d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:35.569003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c06fb-4b0c-4779-b0b6-f5af12d33d65 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:35.575526 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1105/2196] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:35.581763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1092/2197] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:36.077666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349395e-bacd-4675-989c-9e96d11e236e service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:36.080014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e349395e-bacd-4675-989c-9e96d11e236e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:36.108767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349395e-bacd-4675-989c-9e96d11e236e service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:36.131947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:36.132762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:36.133142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:36.133604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] PATH_INFO: `/v3/projects/ef7d62b3a9534abc9dd13e653fef47f1` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:36.135131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7d62b3a9534abc9dd13e653fef47f1)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:36.137803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:36.249597 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7d62b3a9534abc9dd13e653fef47f1', 'request_id': 'req-8a872684-b0b2-4044-a2d1-460c0f41933b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.266370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7d62b3a9534abc9dd13e653fef47f1', 'request_id': 'req-8a872684-b0b2-4044-a2d1-460c0f41933b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.273649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7d62b3a9534abc9dd13e653fef47f1', 'request_id': 'req-8a872684-b0b2-4044-a2d1-460c0f41933b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.292939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] The token cache is being invalidate because project ef7d62b3a9534abc9dd13e653fef47f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:36.293537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.295678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.297786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1106/2198] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:36 2022] DELETE /identity/v3/projects/ef7d62b3a9534abc9dd13e653fef47f1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:36.302187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c06fb-4b0c-4779-b0b6-f5af12d33d65 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:36.315641 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:36.318510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c06fb-4b0c-4779-b0b6-f5af12d33d65 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:36.322337 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:36.387711 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:36.434579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a872684-b0b2-4044-a2d1-460c0f41933b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:36.440683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:36.442173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:36.442553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:36.442923 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] PATH_INFO: `/v3/projects/d274f40b3d8345bea1fb43503bfc130b` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:36.444553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d274f40b3d8345bea1fb43503bfc130b)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:36.449141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:36.458353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:36.459451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:36.460148 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:36.460587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] PATH_INFO: `/v3/users/f4aaba3bbb7541cfba3ec19b8985c1c9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:36.462029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4aaba3bbb7541cfba3ec19b8985c1c9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:36.465253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:36.480558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:36.521818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd274f40b3d8345bea1fb43503bfc130b', 'request_id': 'req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.537065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd274f40b3d8345bea1fb43503bfc130b', 'request_id': 'req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.548072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4aaba3bbb7541cfba3ec19b8985c1c9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.553615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd274f40b3d8345bea1fb43503bfc130b', 'request_id': 'req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.567385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4aaba3bbb7541cfba3ec19b8985c1c9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.570152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] The token cache is being invalidate because project d274f40b3d8345bea1fb43503bfc130b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:36.570319 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.571044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.576559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1107/2199] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:36 2022] DELETE /identity/v3/projects/d274f40b3d8345bea1fb43503bfc130b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:36.577590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:36.577931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4aaba3bbb7541cfba3ec19b8985c1c9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.578882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4aaba3bbb7541cfba3ec19b8985c1c9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.578989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:36.579817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4aaba3bbb7541cfba3ec19b8985c1c9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.613032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1093/2200] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:36 2022] DELETE /identity/v3/users/f4aaba3bbb7541cfba3ec19b8985c1c9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:36.613032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:36.617616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:36.706474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9149e1a-fb89-4b55-bce5-ee2c0d7ef698 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:36.722818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed980c7-7f8c-464f-b665-6412d478e69b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:36.736725 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:36.739643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:36.739945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:36.740226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] PATH_INFO: `/v3/users/83a6160f8bb64db58bc88e4fa12d154f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:36.743351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a6160f8bb64db58bc88e4fa12d154f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:36.746002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:36.832468 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:36.835946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a6160f8bb64db58bc88e4fa12d154f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.861078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:36.862637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:36.863768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:36.866727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] PATH_INFO: `/v3/users/cf3092d8143a4d3e9dd8d632aa0c00e5` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:36.873805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3092d8143a4d3e9dd8d632aa0c00e5)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:36.880418 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a6160f8bb64db58bc88e4fa12d154f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.883603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:36.913802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a6160f8bb64db58bc88e4fa12d154f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.918246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a6160f8bb64db58bc88e4fa12d154f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.919179 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9dd4388c-8085-4aed-83a4-fcba00ac77ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a6160f8bb64db58bc88e4fa12d154f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.950365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1094/2201] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:36 2022] DELETE /identity/v3/users/83a6160f8bb64db58bc88e4fa12d154f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:36.960686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3092d8143a4d3e9dd8d632aa0c00e5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:36.978818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:36.991278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3092d8143a4d3e9dd8d632aa0c00e5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:37.003952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3092d8143a4d3e9dd8d632aa0c00e5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:37.004878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3092d8143a4d3e9dd8d632aa0c00e5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:37.007733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3092d8143a4d3e9dd8d632aa0c00e5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:37.031837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1108/2202] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:36 2022] DELETE /identity/v3/users/cf3092d8143a4d3e9dd8d632aa0c00e5 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:37.033587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa4f8-2695-4a6c-a9d1-2540148fdf76 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:37.033874 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa4f8-2695-4a6c-a9d1-2540148fdf76 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:37.034147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa4f8-2695-4a6c-a9d1-2540148fdf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:37.063701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ed5fa4f8-2695-4a6c-a9d1-2540148fdf76 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:37.065249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ed5fa4f8-2695-4a6c-a9d1-2540148fdf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:37.156972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1095/2203] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:37.168991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:37.172056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:37.303910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64956d05-7d45-4a53-b847-166fddbc3772 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:37.308486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d976f9-53cb-4d63-bf42-bc4de74c827c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:37.309122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d976f9-53cb-4d63-bf42-bc4de74c827c service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:37.309396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d976f9-53cb-4d63-bf42-bc4de74c827c service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:37.309824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d976f9-53cb-4d63-bf42-bc4de74c827c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:37.342492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d976f9-53cb-4d63-bf42-bc4de74c827c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:37.348343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d976f9-53cb-4d63-bf42-bc4de74c827c service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:37.384194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1109/2204] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:37.444908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa4f8-2695-4a6c-a9d1-2540148fdf76 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:37.447271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ed5fa4f8-2695-4a6c-a9d1-2540148fdf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:37.473205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa4f8-2695-4a6c-a9d1-2540148fdf76 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:37.481745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:37.482608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:37.483033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:37.483488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] PATH_INFO: `/v3/projects/119e523611fe423db60159d83031d3ea` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:37.486059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] RBAC: Authorizing `identity:delete_project(project_id=119e523611fe423db60159d83031d3ea)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:37.488239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:37.589692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119e523611fe423db60159d83031d3ea', 'request_id': 'req-fbc36eca-ba57-414f-8bbd-f9561900522a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:37.609788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119e523611fe423db60159d83031d3ea', 'request_id': 'req-fbc36eca-ba57-414f-8bbd-f9561900522a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:37.614572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119e523611fe423db60159d83031d3ea', 'request_id': 'req-fbc36eca-ba57-414f-8bbd-f9561900522a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:37.644152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] The token cache is being invalidate because project 119e523611fe423db60159d83031d3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:37.644854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:37.645570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:37.650176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1096/2205] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:37 2022] DELETE /identity/v3/projects/119e523611fe423db60159d83031d3ea => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:37.654479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a047344-fac1-47e4-aeb6-eb63fdc8f3b2 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:37.654788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a047344-fac1-47e4-aeb6-eb63fdc8f3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:37.655044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a047344-fac1-47e4-aeb6-eb63fdc8f3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:37.668457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:37.673859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:37.722199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0a047344-fac1-47e4-aeb6-eb63fdc8f3b2 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:37.723527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0a047344-fac1-47e4-aeb6-eb63fdc8f3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:37.796346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1110/2206] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:37.803545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:37.805883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad95de1-b399-46b9-9959-7be47b0af8db None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:37.807766 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad95de1-b399-46b9-9959-7be47b0af8db None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:37.808286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad95de1-b399-46b9-9959-7be47b0af8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:37.865327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc36eca-ba57-414f-8bbd-f9561900522a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:37.870354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5ad95de1-b399-46b9-9959-7be47b0af8db None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:37.871616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5ad95de1-b399-46b9-9959-7be47b0af8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:37.872854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:37.873614 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:37.873988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:37.874352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] PATH_INFO: `/v3/projects/91e05b3804f84491a7449a57591b7e7f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:37.875995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e05b3804f84491a7449a57591b7e7f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:37.879624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:37.882275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1111/2207] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:37.887404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad95de1-b399-46b9-9959-7be47b0af8db None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:37.897679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad95de1-b399-46b9-9959-7be47b0af8db None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:37.903344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f41f29-379c-40fc-8a62-45d10915746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:37.904199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f41f29-379c-40fc-8a62-45d10915746c admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:37.904548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f41f29-379c-40fc-8a62-45d10915746c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:37.904925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f41f29-379c-40fc-8a62-45d10915746c admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:37.905735 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f41f29-379c-40fc-8a62-45d10915746c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:37.906167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f41f29-379c-40fc-8a62-45d10915746c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:37.908203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f41f29-379c-40fc-8a62-45d10915746c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:37.929921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1112/2208] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:23:37.935072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f41f29-379c-40fc-8a62-45d10915746c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:37.950038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f41f29-379c-40fc-8a62-45d10915746c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:37.958694 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7717d-f994-40f6-9b0b-26f2734c004d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:37.959474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7717d-f994-40f6-9b0b-26f2734c004d admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:37.959922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7717d-f994-40f6-9b0b-26f2734c004d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:37.960195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7717d-f994-40f6-9b0b-26f2734c004d admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:37.960911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7717d-f994-40f6-9b0b-26f2734c004d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:37.966467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7717d-f994-40f6-9b0b-26f2734c004d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:37.974009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e05b3804f84491a7449a57591b7e7f', 'request_id': 'req-ed7b77a2-8594-4670-a7b6-32a5add0cd57'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:37.999306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e05b3804f84491a7449a57591b7e7f', 'request_id': 'req-ed7b77a2-8594-4670-a7b6-32a5add0cd57'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.015314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e05b3804f84491a7449a57591b7e7f', 'request_id': 'req-ed7b77a2-8594-4670-a7b6-32a5add0cd57'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.017052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1113/2209] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:37 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:38.021527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7717d-f994-40f6-9b0b-26f2734c004d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:38.033228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] The token cache is being invalidate because project 91e05b3804f84491a7449a57591b7e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:38.033228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.033799 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.038851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1097/2210] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:37 2022] DELETE /identity/v3/projects/91e05b3804f84491a7449a57591b7e7f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:38.040096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:38.042782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:38.094477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:38.125697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7717d-f994-40f6-9b0b-26f2734c004d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:38.133582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bd0b6-73ab-44a1-abd9-804f816b4a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:38.135512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bd0b6-73ab-44a1-abd9-804f816b4a57 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:38.135512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bd0b6-73ab-44a1-abd9-804f816b4a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:38.135512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bd0b6-73ab-44a1-abd9-804f816b4a57 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:38.136112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bd0b6-73ab-44a1-abd9-804f816b4a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:38.139235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bd0b6-73ab-44a1-abd9-804f816b4a57 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:38.174205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1114/2211] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:38 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:38.184381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bd0b6-73ab-44a1-abd9-804f816b4a57 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:38.187043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b92bd0b6-73ab-44a1-abd9-804f816b4a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:38.188114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b77a2-8594-4670-a7b6-32a5add0cd57 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:38.194668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:38.196278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:38.196488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:38.196937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] PATH_INFO: `/v3/users/81e2ad0a01f9494381ee703f4e59f061` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:38.199194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e2ad0a01f9494381ee703f4e59f061)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:38.203381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:38.215662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bd0b6-73ab-44a1-abd9-804f816b4a57 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:38.228452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cde3b2-f9ab-41e1-bda1-2868dcfaac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:38.229690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cde3b2-f9ab-41e1-bda1-2868dcfaac71 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:38.230291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cde3b2-f9ab-41e1-bda1-2868dcfaac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:38.230878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cde3b2-f9ab-41e1-bda1-2868dcfaac71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:38.232235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cde3b2-f9ab-41e1-bda1-2868dcfaac71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:38.234543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cde3b2-f9ab-41e1-bda1-2868dcfaac71 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:38.251743 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1115/2212] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:38.256822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cde3b2-f9ab-41e1-bda1-2868dcfaac71 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:38.273315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cde3b2-f9ab-41e1-bda1-2868dcfaac71 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:38.282792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d51443-ea0c-4704-bbc7-3ff7cfa53768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:38.284698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d51443-ea0c-4704-bbc7-3ff7cfa53768 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:38.285890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d51443-ea0c-4704-bbc7-3ff7cfa53768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:38.286391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d51443-ea0c-4704-bbc7-3ff7cfa53768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:38.287846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d51443-ea0c-4704-bbc7-3ff7cfa53768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:38.289657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d51443-ea0c-4704-bbc7-3ff7cfa53768 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:38.308154 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1116/2213] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:38.308358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d51443-ea0c-4704-bbc7-3ff7cfa53768 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:38.317951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-79d51443-ea0c-4704-bbc7-3ff7cfa53768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:38.323390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e2ad0a01f9494381ee703f4e59f061'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.335676 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d51443-ea0c-4704-bbc7-3ff7cfa53768 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:38.342384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e2ad0a01f9494381ee703f4e59f061'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.345267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:38.346235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:38.347053 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:38.347216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] PATH_INFO: `/v3/projects/905aba7a2b3642d08ec452d9a532c278` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:38.349652 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=905aba7a2b3642d08ec452d9a532c278)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:38.352388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:38.355146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e2ad0a01f9494381ee703f4e59f061'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.356286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e2ad0a01f9494381ee703f4e59f061'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.357174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e2ad0a01f9494381ee703f4e59f061'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.360219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:38.388060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1098/2214] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:38 2022] DELETE /identity/v3/users/81e2ad0a01f9494381ee703f4e59f061 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:38.388720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:38.390885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:38.468335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905aba7a2b3642d08ec452d9a532c278', 'request_id': 'req-b4150b28-b857-4d75-8b5e-7538ba585706'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.490170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905aba7a2b3642d08ec452d9a532c278', 'request_id': 'req-b4150b28-b857-4d75-8b5e-7538ba585706'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.498716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905aba7a2b3642d08ec452d9a532c278', 'request_id': 'req-b4150b28-b857-4d75-8b5e-7538ba585706'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.529559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] The token cache is being invalidate because project 905aba7a2b3642d08ec452d9a532c278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:38.529949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.530864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.539921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1117/2215] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:38 2022] DELETE /identity/v3/projects/905aba7a2b3642d08ec452d9a532c278 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:38.549707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37d837-d2e0-48a7-8739-a19b81112d7b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:38.550517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:38.553450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:38.644676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616eafc-1aa2-40eb-a53b-c209c3360518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:38.645422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616eafc-1aa2-40eb-a53b-c209c3360518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:38.645714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616eafc-1aa2-40eb-a53b-c209c3360518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:38.646265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616eafc-1aa2-40eb-a53b-c209c3360518 admin admin] PATH_INFO: `/v3/projects/46d9fab255834ee4b6eca3ee9d786844/users/358cefe30f12437992d17fb45ae3f7b9/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:38.671996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616eafc-1aa2-40eb-a53b-c209c3360518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d9fab255834ee4b6eca3ee9d786844, user_id=358cefe30f12437992d17fb45ae3f7b9, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:38.676885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616eafc-1aa2-40eb-a53b-c209c3360518 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:38.685968 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4150b28-b857-4d75-8b5e-7538ba585706 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:38.697648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:38.699022 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:38.704769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1099/2216] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:38 2022] PUT /identity/v3/projects/46d9fab255834ee4b6eca3ee9d786844/users/358cefe30f12437992d17fb45ae3f7b9/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:38.714912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:38.714912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] PATH_INFO: `/v3/users/3c961143729441209d5b12686ec5c749` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:38.716105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1ec24-3d2d-455b-84af-573653b41f72 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:38.716105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1ec24-3d2d-455b-84af-573653b41f72 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:38.716575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1ec24-3d2d-455b-84af-573653b41f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:38.717841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c961143729441209d5b12686ec5c749)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:38.720732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:38.780857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-81c1ec24-3d2d-455b-84af-573653b41f72 None None] MFA Rules not processed for user `358cefe30f12437992d17fb45ae3f7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:38.784779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-81c1ec24-3d2d-455b-84af-573653b41f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:38.787275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:38.843568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c961143729441209d5b12686ec5c749'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.867241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c961143729441209d5b12686ec5c749'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.893579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c961143729441209d5b12686ec5c749'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.894707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c961143729441209d5b12686ec5c749'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.895681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-5579a0a0-eb74-44e6-bacf-53d57916de80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c961143729441209d5b12686ec5c749'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:38.949945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1118/2217] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:38 2022] DELETE /identity/v3/users/3c961143729441209d5b12686ec5c749 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:38.949945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1aeb-2988-49e4-b3f3-fc09a8cf45a2 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:38.949945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1aeb-2988-49e4-b3f3-fc09a8cf45a2 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:38.949945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1aeb-2988-49e4-b3f3-fc09a8cf45a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:38.953695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1100/2218] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:38.972531 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1ec24-3d2d-455b-84af-573653b41f72 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:38.974873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-81c1ec24-3d2d-455b-84af-573653b41f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.032761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:39.088680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6f2e1aeb-2988-49e4-b3f3-fc09a8cf45a2 None None] MFA Rules not processed for user `2b73ee04318147fe923c80760c3b6cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:39.091714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6f2e1aeb-2988-49e4-b3f3-fc09a8cf45a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.118784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1ec24-3d2d-455b-84af-573653b41f72 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:39.272384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8aa67-de58-4807-99d9-2d753c0f245b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:39.273029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8aa67-de58-4807-99d9-2d753c0f245b service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:39.273433 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8aa67-de58-4807-99d9-2d753c0f245b service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:39.273606 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8aa67-de58-4807-99d9-2d753c0f245b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:39.307115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1119/2219] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:39.307115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e1aeb-2988-49e4-b3f3-fc09a8cf45a2 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:39.307115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6f2e1aeb-2988-49e4-b3f3-fc09a8cf45a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.407998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8aa67-de58-4807-99d9-2d753c0f245b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:39.409475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8aa67-de58-4807-99d9-2d753c0f245b service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:39.430375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e1aeb-2988-49e4-b3f3-fc09a8cf45a2 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:39.440452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:39.441683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:39.442264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:39.442792 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1101/2220] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:39.443170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] PATH_INFO: `/v3/projects/f4284e86e0c24048baa1e629bbbeb6ec` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:39.444351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984482-c462-49a8-8c19-1caea563d645 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:39.444627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984482-c462-49a8-8c19-1caea563d645 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:39.445934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984482-c462-49a8-8c19-1caea563d645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:39.446769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4284e86e0c24048baa1e629bbbeb6ec)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:39.449490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:39.482550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-84984482-c462-49a8-8c19-1caea563d645 None None] MFA Rules not processed for user `2b73ee04318147fe923c80760c3b6cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:39.484057 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-84984482-c462-49a8-8c19-1caea563d645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.494767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1102/2221] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:39.496025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84984482-c462-49a8-8c19-1caea563d645 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:39.499683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-84984482-c462-49a8-8c19-1caea563d645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.526644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84984482-c462-49a8-8c19-1caea563d645 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:39.536864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:39.549144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4284e86e0c24048baa1e629bbbeb6ec', 'request_id': 'req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.565402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4284e86e0c24048baa1e629bbbeb6ec', 'request_id': 'req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.583987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4284e86e0c24048baa1e629bbbeb6ec', 'request_id': 'req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.599890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] The token cache is being invalidate because project f4284e86e0c24048baa1e629bbbeb6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:39.600185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.601018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.603552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1120/2222] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:39 2022] DELETE /identity/v3/projects/f4284e86e0c24048baa1e629bbbeb6ec => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:39.604402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:39.606993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.629930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:39.630676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:39.630919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:39.631236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] PATH_INFO: `/v3/users/358cefe30f12437992d17fb45ae3f7b9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:39.632455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358cefe30f12437992d17fb45ae3f7b9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:39.634568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:39.664566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:39.726363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358cefe30f12437992d17fb45ae3f7b9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.747012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f94b3-5ae8-4f0f-80a2-e6099b2a98b7 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:39.751969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358cefe30f12437992d17fb45ae3f7b9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.754142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb50925-1ada-4272-8eff-a446cb18f748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:39.754902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50925-1ada-4272-8eff-a446cb18f748 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:39.755269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50925-1ada-4272-8eff-a446cb18f748 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:39.755675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50925-1ada-4272-8eff-a446cb18f748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:39.757956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9cb50925-1ada-4272-8eff-a446cb18f748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.767037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358cefe30f12437992d17fb45ae3f7b9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.768372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358cefe30f12437992d17fb45ae3f7b9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.769190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358cefe30f12437992d17fb45ae3f7b9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.787858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1103/2223] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:39 2022] DELETE /identity/v3/users/358cefe30f12437992d17fb45ae3f7b9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:39.791408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:39.791408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.834296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb50925-1ada-4272-8eff-a446cb18f748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:39.836209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb50925-1ada-4272-8eff-a446cb18f748 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:39.849398 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1121/2224] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:39.850800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96e3f7-0115-4d54-9786-f4d8099ad326 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:39.851093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96e3f7-0115-4d54-9786-f4d8099ad326 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:39.851890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96e3f7-0115-4d54-9786-f4d8099ad326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:39.880591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-dc96e3f7-0115-4d54-9786-f4d8099ad326 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:39.881828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-dc96e3f7-0115-4d54-9786-f4d8099ad326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.882955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975947f6-a498-4024-a4be-a96d32a940e1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:39.890045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:39.890709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:39.891031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:39.891265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] PATH_INFO: `/v3/projects/247e2949d93b417e80de6522172b12df` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:39.893979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] RBAC: Authorizing `identity:delete_project(project_id=247e2949d93b417e80de6522172b12df)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:39.896027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:39.899557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1122/2225] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:39.902470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6540372-5e13-473c-900e-ac8e0b01ba78 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:39.902975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6540372-5e13-473c-900e-ac8e0b01ba78 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:39.904168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6540372-5e13-473c-900e-ac8e0b01ba78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:39.931857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f6540372-5e13-473c-900e-ac8e0b01ba78 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:39.933100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f6540372-5e13-473c-900e-ac8e0b01ba78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.946124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1123/2226] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:39.947979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498342b0-3409-42b8-9092-532faf80f068 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:39.948412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498342b0-3409-42b8-9092-532faf80f068 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:39.948828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498342b0-3409-42b8-9092-532faf80f068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:39.971904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-498342b0-3409-42b8-9092-532faf80f068 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:39.972121 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247e2949d93b417e80de6522172b12df', 'request_id': 'req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.973514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-498342b0-3409-42b8-9092-532faf80f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:39.987842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247e2949d93b417e80de6522172b12df', 'request_id': 'req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:39.994905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247e2949d93b417e80de6522172b12df', 'request_id': 'req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:40.007290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] The token cache is being invalidate because project 247e2949d93b417e80de6522172b12df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:40.007689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:40.008426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:40.010350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1104/2227] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:39 2022] DELETE /identity/v3/projects/247e2949d93b417e80de6522172b12df => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:40.015210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.016704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:40.027517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:40.050005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1124/2228] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:40.051350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed2e8-2471-47e4-b2c0-da6c25b7f9c7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.051862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed2e8-2471-47e4-b2c0-da6c25b7f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.052142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed2e8-2471-47e4-b2c0-da6c25b7f9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.057347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:40.079726 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0f1ed2e8-2471-47e4-b2c0-da6c25b7f9c7 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:40.080906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0f1ed2e8-2471-47e4-b2c0-da6c25b7f9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:40.090837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1125/2229] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:40.097200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ed2e8-2471-47e4-b2c0-da6c25b7f9c7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.112047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ed2e8-2471-47e4-b2c0-da6c25b7f9c7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.114156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31ccb2-72ac-48b7-8a6c-34d1823cdfed admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.118975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb64cb-6065-4309-a6fb-bd668df7551d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.119759 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb64cb-6065-4309-a6fb-bd668df7551d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.120149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb64cb-6065-4309-a6fb-bd668df7551d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.120438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb64cb-6065-4309-a6fb-bd668df7551d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.120892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae152d5f-8c8c-49c3-aef7-c53f85505da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.121888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152d5f-8c8c-49c3-aef7-c53f85505da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.122168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152d5f-8c8c-49c3-aef7-c53f85505da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.122510 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152d5f-8c8c-49c3-aef7-c53f85505da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.123432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae152d5f-8c8c-49c3-aef7-c53f85505da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:40.123803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae152d5f-8c8c-49c3-aef7-c53f85505da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.127307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e5bb64cb-6065-4309-a6fb-bd668df7551d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:40.128728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae152d5f-8c8c-49c3-aef7-c53f85505da7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.140392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1126/2230] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:40.141833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a44a9-1a16-4095-ba8f-471233e0f424 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.142117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a44a9-1a16-4095-ba8f-471233e0f424 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.142387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a44a9-1a16-4095-ba8f-471233e0f424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.148304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb64cb-6065-4309-a6fb-bd668df7551d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.149782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb64cb-6065-4309-a6fb-bd668df7551d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.167437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1105/2231] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:40.169241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb64cb-6065-4309-a6fb-bd668df7551d service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.175406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ab9a44a9-1a16-4095-ba8f-471233e0f424 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:40.182096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ab9a44a9-1a16-4095-ba8f-471233e0f424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:40.182902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb64cb-6065-4309-a6fb-bd668df7551d service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.188777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a1a39-0322-4b0d-bedd-42408e011fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.189558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a1a39-0322-4b0d-bedd-42408e011fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.189938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a1a39-0322-4b0d-bedd-42408e011fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.193881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a1a39-0322-4b0d-bedd-42408e011fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.193881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a1a39-0322-4b0d-bedd-42408e011fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.193881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a1a39-0322-4b0d-bedd-42408e011fe3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.211053 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1127/2232] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:40.212264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a44a9-1a16-4095-ba8f-471233e0f424 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.224348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a44a9-1a16-4095-ba8f-471233e0f424 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.237712 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fd49c-f142-4fa3-bc0f-4e4fb5c74e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.238342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fd49c-f142-4fa3-bc0f-4e4fb5c74e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.238622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fd49c-f142-4fa3-bc0f-4e4fb5c74e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.238943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fd49c-f142-4fa3-bc0f-4e4fb5c74e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.239481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1106/2233] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:40 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:40.239680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fd49c-f142-4fa3-bc0f-4e4fb5c74e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:40.239987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fd49c-f142-4fa3-bc0f-4e4fb5c74e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.241853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fd49c-f142-4fa3-bc0f-4e4fb5c74e82 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.244912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a1a39-0322-4b0d-bedd-42408e011fe3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.261482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1128/2234] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:23:40.264142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fd49c-f142-4fa3-bc0f-4e4fb5c74e82 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.283554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fd49c-f142-4fa3-bc0f-4e4fb5c74e82 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.373984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a1a39-0322-4b0d-bedd-42408e011fe3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.383623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564538b2-3cee-46c1-a60b-b0f28d26d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.386244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564538b2-3cee-46c1-a60b-b0f28d26d47e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.386537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564538b2-3cee-46c1-a60b-b0f28d26d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.386819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564538b2-3cee-46c1-a60b-b0f28d26d47e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.387651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564538b2-3cee-46c1-a60b-b0f28d26d47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.389675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564538b2-3cee-46c1-a60b-b0f28d26d47e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.401125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137da49-6a4b-4ba9-af30-e5e3928178f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.401856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137da49-6a4b-4ba9-af30-e5e3928178f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.402575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137da49-6a4b-4ba9-af30-e5e3928178f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.402852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137da49-6a4b-4ba9-af30-e5e3928178f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.403579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137da49-6a4b-4ba9-af30-e5e3928178f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.406168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137da49-6a4b-4ba9-af30-e5e3928178f1 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.431503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1107/2235] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:40 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:40.434523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564538b2-3cee-46c1-a60b-b0f28d26d47e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.439970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-564538b2-3cee-46c1-a60b-b0f28d26d47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:40.450552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1129/2236] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:40 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:40.452012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137da49-6a4b-4ba9-af30-e5e3928178f1 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.470197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564538b2-3cee-46c1-a60b-b0f28d26d47e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.552280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.553018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.553308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.553587 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] PATH_INFO: `/v3/users/9e409b676b3e4fcb9560dda20b169a56` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.555026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e409b676b3e4fcb9560dda20b169a56)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.558100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.572895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137da49-6a4b-4ba9-af30-e5e3928178f1 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.578914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a71f0-a5fa-4b65-8b2e-d92e60cb9e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.580035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a71f0-a5fa-4b65-8b2e-d92e60cb9e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.580390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a71f0-a5fa-4b65-8b2e-d92e60cb9e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.580728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a71f0-a5fa-4b65-8b2e-d92e60cb9e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.581469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a71f0-a5fa-4b65-8b2e-d92e60cb9e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.583652 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a71f0-a5fa-4b65-8b2e-d92e60cb9e92 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.609905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1130/2237] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:40.610870 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a71f0-a5fa-4b65-8b2e-d92e60cb9e92 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.632192 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:40.636372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a71f0-a5fa-4b65-8b2e-d92e60cb9e92 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.641488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e409b676b3e4fcb9560dda20b169a56'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:40.660435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408a01e-415e-4b1b-9b82-f3d6873ba55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.660435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408a01e-415e-4b1b-9b82-f3d6873ba55c admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.660435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408a01e-415e-4b1b-9b82-f3d6873ba55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.660435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408a01e-415e-4b1b-9b82-f3d6873ba55c admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.660771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408a01e-415e-4b1b-9b82-f3d6873ba55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.660771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408a01e-415e-4b1b-9b82-f3d6873ba55c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.668729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e409b676b3e4fcb9560dda20b169a56'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:40.680390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e409b676b3e4fcb9560dda20b169a56'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:40.681500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e409b676b3e4fcb9560dda20b169a56'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:40.683728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e409b676b3e4fcb9560dda20b169a56'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:40.691537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1131/2238] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:40 2022] POST /identity/v3/users => generated 293 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:40.692663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408a01e-415e-4b1b-9b82-f3d6873ba55c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.694366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c408a01e-415e-4b1b-9b82-f3d6873ba55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:40.710423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1108/2239] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:40 2022] DELETE /identity/v3/users/9e409b676b3e4fcb9560dda20b169a56 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:40.712372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.714644 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:40.734590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408a01e-415e-4b1b-9b82-f3d6873ba55c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.744892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:40.813789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16000778-af77-403a-b9cc-ef24d5b59b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.814644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000778-af77-403a-b9cc-ef24d5b59b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.815016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000778-af77-403a-b9cc-ef24d5b59b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.815406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000778-af77-403a-b9cc-ef24d5b59b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.816162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16000778-af77-403a-b9cc-ef24d5b59b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.818634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16000778-af77-403a-b9cc-ef24d5b59b52 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.838732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1132/2240] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:40.854783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0dbe9-8d87-44a6-84c7-ac272a7bcd46 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.854783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0dbe9-8d87-44a6-84c7-ac272a7bcd46 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.854783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0dbe9-8d87-44a6-84c7-ac272a7bcd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.866387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb285d3a-166d-40f8-b2b7-037f2322f72e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.875615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c06714-6f02-4cd8-b38a-bd4483b1c393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.875958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c06714-6f02-4cd8-b38a-bd4483b1c393 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.876306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c06714-6f02-4cd8-b38a-bd4483b1c393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.876657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c06714-6f02-4cd8-b38a-bd4483b1c393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.877443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c06714-6f02-4cd8-b38a-bd4483b1c393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.879976 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c06714-6f02-4cd8-b38a-bd4483b1c393 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.903592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-55a0dbe9-8d87-44a6-84c7-ac272a7bcd46 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:40.904677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1109/2241] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:40.905213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c06714-6f02-4cd8-b38a-bd4483b1c393 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:40.908749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-55a0dbe9-8d87-44a6-84c7-ac272a7bcd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:40.924178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c06714-6f02-4cd8-b38a-bd4483b1c393 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:40.925659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1133/2242] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:40.927083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6405c9-e7b5-40ae-a229-78a019516980 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.927435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6405c9-e7b5-40ae-a229-78a019516980 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.927712 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6405c9-e7b5-40ae-a229-78a019516980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.938312 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641f2eb-2bc5-418b-9fca-09ac0fa1eda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:40.939339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641f2eb-2bc5-418b-9fca-09ac0fa1eda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:40.939894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641f2eb-2bc5-418b-9fca-09ac0fa1eda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:40.940031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641f2eb-2bc5-418b-9fca-09ac0fa1eda7 admin admin] PATH_INFO: `/v3/projects/9d17dddcc60f43928d628499135cba79/users/faf38182e69e4c70acebe6193e3e6768/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:40.957257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641f2eb-2bc5-418b-9fca-09ac0fa1eda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d17dddcc60f43928d628499135cba79, user_id=faf38182e69e4c70acebe6193e3e6768, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:40.960625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641f2eb-2bc5-418b-9fca-09ac0fa1eda7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:40.973723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8a6405c9-e7b5-40ae-a229-78a019516980 None None] MFA Rules not processed for user `2b73ee04318147fe923c80760c3b6cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:40.975618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8a6405c9-e7b5-40ae-a229-78a019516980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:40.995236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1110/2243] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:40 2022] PUT /identity/v3/projects/9d17dddcc60f43928d628499135cba79/users/faf38182e69e4c70acebe6193e3e6768/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:40.996241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641f2eb-2bc5-418b-9fca-09ac0fa1eda7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:41.082075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1134/2244] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:41.082998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6405c9-e7b5-40ae-a229-78a019516980 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:41.084383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8a6405c9-e7b5-40ae-a229-78a019516980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:41.115673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641f2eb-2bc5-418b-9fca-09ac0fa1eda7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:41.123568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7ca9a-0d95-46eb-8f36-3e4524eff045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:41.124720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ca9a-0d95-46eb-8f36-3e4524eff045 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.125154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ca9a-0d95-46eb-8f36-3e4524eff045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.125501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ca9a-0d95-46eb-8f36-3e4524eff045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.126840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7ca9a-0d95-46eb-8f36-3e4524eff045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:41.128966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7ca9a-0d95-46eb-8f36-3e4524eff045 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:41.144050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1111/2245] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:41.145424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09b1f-d856-45d4-beb8-53d503bb53fa None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.145715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09b1f-d856-45d4-beb8-53d503bb53fa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.145980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09b1f-d856-45d4-beb8-53d503bb53fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.182190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6405c9-e7b5-40ae-a229-78a019516980 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:41.194404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a4d09b1f-d856-45d4-beb8-53d503bb53fa None None] MFA Rules not processed for user `faf38182e69e4c70acebe6193e3e6768`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:41.196436 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a4d09b1f-d856-45d4-beb8-53d503bb53fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:41.222807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:41.305592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cad5d2-252f-4ff6-b374-f05f9f8fee6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:41.305971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cad5d2-252f-4ff6-b374-f05f9f8fee6c service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.306312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cad5d2-252f-4ff6-b374-f05f9f8fee6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.306596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cad5d2-252f-4ff6-b374-f05f9f8fee6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.318952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1112/2246] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:41.331614 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d09b1f-d856-45d4-beb8-53d503bb53fa None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:41.334003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a4d09b1f-d856-45d4-beb8-53d503bb53fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:41.338782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cad5d2-252f-4ff6-b374-f05f9f8fee6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:41.340312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cad5d2-252f-4ff6-b374-f05f9f8fee6c service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:41.356895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1135/2247] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:41.358239 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cad5d2-252f-4ff6-b374-f05f9f8fee6c service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:41.360366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d09b1f-d856-45d4-beb8-53d503bb53fa None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:41.372233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cad5d2-252f-4ff6-b374-f05f9f8fee6c service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:41.373690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:41.374895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.375528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.375800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] PATH_INFO: `/v3/projects/46d9fab255834ee4b6eca3ee9d786844` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.377221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d9fab255834ee4b6eca3ee9d786844)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:41.378464 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c64b9c-c6ff-48c2-b113-023824a36955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:41.379215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c64b9c-c6ff-48c2-b113-023824a36955 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.379608 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c64b9c-c6ff-48c2-b113-023824a36955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.379817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:41.379961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c64b9c-c6ff-48c2-b113-023824a36955 admin admin] PATH_INFO: `/v3/projects/6eedeb56f0e44bd59da7c258861c7b55/users/dd303741a52a4cf28dad83c22416edbe/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.382741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:41.418072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c64b9c-c6ff-48c2-b113-023824a36955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eedeb56f0e44bd59da7c258861c7b55, user_id=dd303741a52a4cf28dad83c22416edbe, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:41.422143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c64b9c-c6ff-48c2-b113-023824a36955 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:41.449662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1136/2248] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:41 2022] PUT /identity/v3/projects/6eedeb56f0e44bd59da7c258861c7b55/users/dd303741a52a4cf28dad83c22416edbe/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:41.451202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c64b9c-c6ff-48c2-b113-023824a36955 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:41.453976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-47c64b9c-c6ff-48c2-b113-023824a36955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:41.456919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d9fab255834ee4b6eca3ee9d786844', 'request_id': 'req-a7f5e769-94e7-41cc-9efa-dfbdf2137523'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:41.469381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d9fab255834ee4b6eca3ee9d786844', 'request_id': 'req-a7f5e769-94e7-41cc-9efa-dfbdf2137523'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:41.480897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d9fab255834ee4b6eca3ee9d786844', 'request_id': 'req-a7f5e769-94e7-41cc-9efa-dfbdf2137523'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:41.505075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] The token cache is being invalidate because project 46d9fab255834ee4b6eca3ee9d786844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:41.505784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:41.506524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a7f5e769-94e7-41cc-9efa-dfbdf2137523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:41.512569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1113/2249] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:41 2022] DELETE /identity/v3/projects/46d9fab255834ee4b6eca3ee9d786844 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:41.514235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c475ae-4187-4fc7-b849-6d332c921d45 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.514586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c475ae-4187-4fc7-b849-6d332c921d45 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.514924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c475ae-4187-4fc7-b849-6d332c921d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.558373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e5c475ae-4187-4fc7-b849-6d332c921d45 None None] MFA Rules not processed for user `dd303741a52a4cf28dad83c22416edbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:41.560175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e5c475ae-4187-4fc7-b849-6d332c921d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:41.621675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c64b9c-c6ff-48c2-b113-023824a36955 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:41.653327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1114/2250] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:41.654788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904fba6-2a5a-47c5-bfce-e96779173aa3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.655197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904fba6-2a5a-47c5-bfce-e96779173aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.655565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904fba6-2a5a-47c5-bfce-e96779173aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.696425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6904fba6-2a5a-47c5-bfce-e96779173aa3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:41.701394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6904fba6-2a5a-47c5-bfce-e96779173aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:41.720886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df0f5-4fe7-4ea9-b3c1-bc87a7f582d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54131719962e4463b0b874916cb40973', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:41.721951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df0f5-4fe7-4ea9-b3c1-bc87a7f582d3 service glance] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.722241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df0f5-4fe7-4ea9-b3c1-bc87a7f582d3 service glance] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.722515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df0f5-4fe7-4ea9-b3c1-bc87a7f582d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.724646 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-683df0f5-4fe7-4ea9-b3c1-bc87a7f582d3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:41.733566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:41.824112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683df0f5-4fe7-4ea9-b3c1-bc87a7f582d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:41.826214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683df0f5-4fe7-4ea9-b3c1-bc87a7f582d3 service glance] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:41.838078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1115/2251] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:41.838078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904fba6-2a5a-47c5-bfce-e96779173aa3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:41.838078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6904fba6-2a5a-47c5-bfce-e96779173aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:41.846857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1137/2252] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:41.849644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f76cb-6b56-4256-aae2-0e6224cedb59 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.850531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f76cb-6b56-4256-aae2-0e6224cedb59 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.851002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f76cb-6b56-4256-aae2-0e6224cedb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.876851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4f9f76cb-6b56-4256-aae2-0e6224cedb59 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:41.878734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4f9f76cb-6b56-4256-aae2-0e6224cedb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:41.894627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1138/2253] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:41.899645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f76cb-6b56-4256-aae2-0e6224cedb59 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:41.913209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f76cb-6b56-4256-aae2-0e6224cedb59 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:41.920949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab5093-6fbf-40af-9774-238d0ec8e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:41.921921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab5093-6fbf-40af-9774-238d0ec8e971 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.922401 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab5093-6fbf-40af-9774-238d0ec8e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.922866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab5093-6fbf-40af-9774-238d0ec8e971 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.923941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab5093-6fbf-40af-9774-238d0ec8e971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:41.924439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab5093-6fbf-40af-9774-238d0ec8e971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:41.926430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab5093-6fbf-40af-9774-238d0ec8e971 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:41.944330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1139/2254] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:23:41.944639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904fba6-2a5a-47c5-bfce-e96779173aa3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:41.946481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab5093-6fbf-40af-9774-238d0ec8e971 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:41.949936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a7282-456c-47f1-b20c-d14f43b33743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:41.950861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a7282-456c-47f1-b20c-d14f43b33743 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.951210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a7282-456c-47f1-b20c-d14f43b33743 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.951675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a7282-456c-47f1-b20c-d14f43b33743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:41.965921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a7282-456c-47f1-b20c-d14f43b33743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:41.968586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a7282-456c-47f1-b20c-d14f43b33743 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:41.971467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab5093-6fbf-40af-9774-238d0ec8e971 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:41.985794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1116/2255] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:41.995818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bc837-3938-479c-9f7c-e672bd0210f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:41.999205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bc837-3938-479c-9f7c-e672bd0210f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:41.999528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bc837-3938-479c-9f7c-e672bd0210f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:41.999808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bc837-3938-479c-9f7c-e672bd0210f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:42.000486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bc837-3938-479c-9f7c-e672bd0210f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:42.001273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a7282-456c-47f1-b20c-d14f43b33743 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:42.002421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bc837-3938-479c-9f7c-e672bd0210f7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:42.002733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d26a7282-456c-47f1-b20c-d14f43b33743 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:42.023107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a7282-456c-47f1-b20c-d14f43b33743 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:42.032311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:42.033629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:42.034312 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:42.034601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:42.034879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] PATH_INFO: `/v3/projects/a2ef691546cc4493837c51183473fa53` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:42.042273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ef691546cc4493837c51183473fa53)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:42.048421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:42.084076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1140/2256] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:41 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:42.085066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bc837-3938-479c-9f7c-e672bd0210f7 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:42.088238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-208bc837-3938-479c-9f7c-e672bd0210f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:42.197412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ef691546cc4493837c51183473fa53', 'request_id': 'req-763f4729-0bab-47b1-8753-9e878feafd15'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.209961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ef691546cc4493837c51183473fa53', 'request_id': 'req-763f4729-0bab-47b1-8753-9e878feafd15'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.219133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ef691546cc4493837c51183473fa53', 'request_id': 'req-763f4729-0bab-47b1-8753-9e878feafd15'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.233034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] The token cache is being invalidate because project a2ef691546cc4493837c51183473fa53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:42.233911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.234774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.236981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1117/2257] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:41 2022] DELETE /identity/v3/projects/a2ef691546cc4493837c51183473fa53 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:42.238253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:42.240519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:42.268455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bc837-3938-479c-9f7c-e672bd0210f7 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:42.373609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:42.391352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f4729-0bab-47b1-8753-9e878feafd15 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:42.398970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeefe8-e817-4bb3-8eb5-fdf36f77cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:42.399907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeefe8-e817-4bb3-8eb5-fdf36f77cffd admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:42.400474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeefe8-e817-4bb3-8eb5-fdf36f77cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:42.400961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeefe8-e817-4bb3-8eb5-fdf36f77cffd admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:42.402937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeefe8-e817-4bb3-8eb5-fdf36f77cffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:42.405392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeefe8-e817-4bb3-8eb5-fdf36f77cffd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:42.419710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:42.420356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:42.420635 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:42.423209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] PATH_INFO: `/v3/users/dd303741a52a4cf28dad83c22416edbe` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:42.425343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd303741a52a4cf28dad83c22416edbe)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:42.429438 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:42.448047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1118/2258] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:42 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:42.449654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeefe8-e817-4bb3-8eb5-fdf36f77cffd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:42.453223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4cdeefe8-e817-4bb3-8eb5-fdf36f77cffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:42.475001 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeefe8-e817-4bb3-8eb5-fdf36f77cffd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:42.482250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:42.483232 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:42.483602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:42.483881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] PATH_INFO: `/v3/users/b23bd36d9f9647f5acde9d00f34e89fe` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:42.485165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23bd36d9f9647f5acde9d00f34e89fe)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:42.489638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:42.588701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd303741a52a4cf28dad83c22416edbe'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.598135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23bd36d9f9647f5acde9d00f34e89fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.628325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23bd36d9f9647f5acde9d00f34e89fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.637647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd303741a52a4cf28dad83c22416edbe'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.659069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23bd36d9f9647f5acde9d00f34e89fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.661677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd303741a52a4cf28dad83c22416edbe'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.662504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23bd36d9f9647f5acde9d00f34e89fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.663479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd303741a52a4cf28dad83c22416edbe'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.664445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd303741a52a4cf28dad83c22416edbe'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.667514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bb39b9a7-120f-41db-8375-d9f7fcdaf19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23bd36d9f9647f5acde9d00f34e89fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:42.703741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1141/2259] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:42 2022] DELETE /identity/v3/users/dd303741a52a4cf28dad83c22416edbe => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:42.707378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:42.710474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1119/2260] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:42 2022] DELETE /identity/v3/users/b23bd36d9f9647f5acde9d00f34e89fe => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:42.717469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:42.724990 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec73ac-b428-4eb4-800a-a54142869f55 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:42.725273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec73ac-b428-4eb4-800a-a54142869f55 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:42.725555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec73ac-b428-4eb4-800a-a54142869f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:42.777376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:42.828706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9cec73ac-b428-4eb4-800a-a54142869f55 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:42.832261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9cec73ac-b428-4eb4-800a-a54142869f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:42.897519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71919e2-a172-460c-8975-a0177c5e6d8c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:43.016324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1120/2261] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:43.032994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec73ac-b428-4eb4-800a-a54142869f55 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:43.035185 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9cec73ac-b428-4eb4-800a-a54142869f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:43.045428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f02f8b-7e52-41aa-aac9-a8409709c142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:43.046509 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f02f8b-7e52-41aa-aac9-a8409709c142 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:43.047050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f02f8b-7e52-41aa-aac9-a8409709c142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:43.053297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f02f8b-7e52-41aa-aac9-a8409709c142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:43.057829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f02f8b-7e52-41aa-aac9-a8409709c142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:43.061836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f02f8b-7e52-41aa-aac9-a8409709c142 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:43.100911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1142/2262] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:43.102377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f02f8b-7e52-41aa-aac9-a8409709c142 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:43.108180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b6f02f8b-7e52-41aa-aac9-a8409709c142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:43.123671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec73ac-b428-4eb4-800a-a54142869f55 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:43.134033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81f85c-5311-49f4-a1c9-19d10d222949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:43.134662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81f85c-5311-49f4-a1c9-19d10d222949 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:43.135238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81f85c-5311-49f4-a1c9-19d10d222949 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:43.135659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81f85c-5311-49f4-a1c9-19d10d222949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:43.138332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f02f8b-7e52-41aa-aac9-a8409709c142 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:43.150157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc6ef0-61fd-4347-be90-8091f1467d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:43.153116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6ef0-61fd-4347-be90-8091f1467d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:43.153243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81f85c-5311-49f4-a1c9-19d10d222949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:43.153356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6ef0-61fd-4347-be90-8091f1467d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:43.153356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6ef0-61fd-4347-be90-8091f1467d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:43.155584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc6ef0-61fd-4347-be90-8091f1467d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:43.155862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81f85c-5311-49f4-a1c9-19d10d222949 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:43.157158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc6ef0-61fd-4347-be90-8091f1467d4e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:43.163096 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:43.176315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1121/2263] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:23:43.188425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1143/2264] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:43.198635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81f85c-5311-49f4-a1c9-19d10d222949 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:43.206704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81f85c-5311-49f4-a1c9-19d10d222949 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:43.219575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ea472-e746-4405-aded-56460e08c77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:43.220867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea472-e746-4405-aded-56460e08c77a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:43.222328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea472-e746-4405-aded-56460e08c77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:43.223129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea472-e746-4405-aded-56460e08c77a admin admin] PATH_INFO: `/v3/projects/614435d56a644c87851652912f77eafb/users/4b2683d66665426e8a60614971b04bcc/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:43.265395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ea472-e746-4405-aded-56460e08c77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=614435d56a644c87851652912f77eafb, user_id=4b2683d66665426e8a60614971b04bcc, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:43.271157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ea472-e746-4405-aded-56460e08c77a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:43.298827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1122/2265] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:43 2022] PUT /identity/v3/projects/614435d56a644c87851652912f77eafb/users/4b2683d66665426e8a60614971b04bcc/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:23:43.303634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f338e-7f29-4b7e-b94d-14b28103d77b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:43.303969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f338e-7f29-4b7e-b94d-14b28103d77b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:43.304230 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f338e-7f29-4b7e-b94d-14b28103d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:43.348768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-722f338e-7f29-4b7e-b94d-14b28103d77b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:43.350074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-722f338e-7f29-4b7e-b94d-14b28103d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:43.600378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1144/2266] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:43.668319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ea472-e746-4405-aded-56460e08c77a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:43.670629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b94ea472-e746-4405-aded-56460e08c77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:43.740644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f338e-7f29-4b7e-b94d-14b28103d77b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:43.742408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-722f338e-7f29-4b7e-b94d-14b28103d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:43.766363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f338e-7f29-4b7e-b94d-14b28103d77b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:43.779138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:43.780143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:43.781920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:43.782351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] PATH_INFO: `/v3/projects/95c6ec8c0498497d8eda22f6e5017916` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:43.788618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c6ec8c0498497d8eda22f6e5017916)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:43.791837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:43.824076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ea472-e746-4405-aded-56460e08c77a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:43.831143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a880b6-5651-4369-95c1-dd55ea3c806c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:43.833420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a880b6-5651-4369-95c1-dd55ea3c806c service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:43.833937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a880b6-5651-4369-95c1-dd55ea3c806c service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:43.835134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a880b6-5651-4369-95c1-dd55ea3c806c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:43.848778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a880b6-5651-4369-95c1-dd55ea3c806c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:43.852514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a880b6-5651-4369-95c1-dd55ea3c806c service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:43.871398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1123/2267] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:43.900665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:43.957557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c6ec8c0498497d8eda22f6e5017916', 'request_id': 'req-b3f3caaf-a622-4e56-a428-91a66abbf0cc'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:43.978320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c6ec8c0498497d8eda22f6e5017916', 'request_id': 'req-b3f3caaf-a622-4e56-a428-91a66abbf0cc'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:43.979741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a880b6-5651-4369-95c1-dd55ea3c806c service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:43.983690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b1a880b6-5651-4369-95c1-dd55ea3c806c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:43.998141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c6ec8c0498497d8eda22f6e5017916', 'request_id': 'req-b3f3caaf-a622-4e56-a428-91a66abbf0cc'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:44.003284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a880b6-5651-4369-95c1-dd55ea3c806c service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:44.048494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] The token cache is being invalidate because project 95c6ec8c0498497d8eda22f6e5017916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:44.048790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:44.049942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b3f3caaf-a622-4e56-a428-91a66abbf0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:44.052432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1145/2268] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:43 2022] DELETE /identity/v3/projects/95c6ec8c0498497d8eda22f6e5017916 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:44.070724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e547b83-e1ac-4edb-be75-88a28529b511 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.070880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e547b83-e1ac-4edb-be75-88a28529b511 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.071342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e547b83-e1ac-4edb-be75-88a28529b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.104717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8e547b83-e1ac-4edb-be75-88a28529b511 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:44.106205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8e547b83-e1ac-4edb-be75-88a28529b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:44.108439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:44.109874 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.110236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.110517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] PATH_INFO: `/v3/projects/6eedeb56f0e44bd59da7c258861c7b55` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.111795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eedeb56f0e44bd59da7c258861c7b55)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:44.113758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:44.118679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1146/2269] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:44.126912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087dcdd-0cc9-417d-bfef-d5b63a4ce8e6 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.127201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087dcdd-0cc9-417d-bfef-d5b63a4ce8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.127504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087dcdd-0cc9-417d-bfef-d5b63a4ce8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.164336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7087dcdd-0cc9-417d-bfef-d5b63a4ce8e6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:44.165671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7087dcdd-0cc9-417d-bfef-d5b63a4ce8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:44.203307 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eedeb56f0e44bd59da7c258861c7b55', 'request_id': 'req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:44.218404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eedeb56f0e44bd59da7c258861c7b55', 'request_id': 'req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:44.235067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eedeb56f0e44bd59da7c258861c7b55', 'request_id': 'req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:44.276130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] The token cache is being invalidate because project 6eedeb56f0e44bd59da7c258861c7b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:44.276797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:44.277743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f3a83ee9-fb49-4685-89a0-5b1a28853dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:44.282011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1124/2270] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:43 2022] DELETE /identity/v3/projects/6eedeb56f0e44bd59da7c258861c7b55 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:44.290228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b09dc-c34e-478b-83c4-b68a5e1cfaf6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.291017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b09dc-c34e-478b-83c4-b68a5e1cfaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.291552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b09dc-c34e-478b-83c4-b68a5e1cfaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.304417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1147/2271] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:44.308861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087dcdd-0cc9-417d-bfef-d5b63a4ce8e6 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:44.318214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087dcdd-0cc9-417d-bfef-d5b63a4ce8e6 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:44.324291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b850-3de7-4f19-bf57-73fa9610c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:44.325259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b850-3de7-4f19-bf57-73fa9610c0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.325259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b850-3de7-4f19-bf57-73fa9610c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.325454 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b850-3de7-4f19-bf57-73fa9610c0e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.326142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3b850-3de7-4f19-bf57-73fa9610c0e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:44.326393 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3b850-3de7-4f19-bf57-73fa9610c0e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:44.328370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3b850-3de7-4f19-bf57-73fa9610c0e0 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:44.328951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:44.343871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7b3b09dc-c34e-478b-83c4-b68a5e1cfaf6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:44.348386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1148/2272] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:23:44.349383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b850-3de7-4f19-bf57-73fa9610c0e0 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:44.350728 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7b3b09dc-c34e-478b-83c4-b68a5e1cfaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:44.367187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b850-3de7-4f19-bf57-73fa9610c0e0 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:44.375310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1125/2273] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:44.378257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d671f96-2bf5-4d30-bdc5-ae5e22ec24cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:44.378900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d671f96-2bf5-4d30-bdc5-ae5e22ec24cb admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.379182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d671f96-2bf5-4d30-bdc5-ae5e22ec24cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.379540 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d671f96-2bf5-4d30-bdc5-ae5e22ec24cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.383315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0458d-ded6-4994-91c7-dd5f2e816dc0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.383698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0458d-ded6-4994-91c7-dd5f2e816dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.384472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0458d-ded6-4994-91c7-dd5f2e816dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.384590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d671f96-2bf5-4d30-bdc5-ae5e22ec24cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:44.386831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d671f96-2bf5-4d30-bdc5-ae5e22ec24cb admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:44.431777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bcf0458d-ded6-4994-91c7-dd5f2e816dc0 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:44.432305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1149/2274] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:44 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:44.433390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d671f96-2bf5-4d30-bdc5-ae5e22ec24cb admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:44.436202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bcf0458d-ded6-4994-91c7-dd5f2e816dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:44.586689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d671f96-2bf5-4d30-bdc5-ae5e22ec24cb admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:44.600228 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ac74d-0f6d-46a2-acc4-4c3934b0c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:44.600868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ac74d-0f6d-46a2-acc4-4c3934b0c72b admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.601789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ac74d-0f6d-46a2-acc4-4c3934b0c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.601789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ac74d-0f6d-46a2-acc4-4c3934b0c72b admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.602382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ac74d-0f6d-46a2-acc4-4c3934b0c72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:44.608453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ac74d-0f6d-46a2-acc4-4c3934b0c72b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:44.630268 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1126/2275] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:44.635330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0458d-ded6-4994-91c7-dd5f2e816dc0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:44.652042 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1150/2276] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:44 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:44.667115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0458d-ded6-4994-91c7-dd5f2e816dc0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:44.677108 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ac74d-0f6d-46a2-acc4-4c3934b0c72b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:44.682778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977f41a-bf5f-4aa0-814d-dec1b2621722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:44.683488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977f41a-bf5f-4aa0-814d-dec1b2621722 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.683723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977f41a-bf5f-4aa0-814d-dec1b2621722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.683927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977f41a-bf5f-4aa0-814d-dec1b2621722 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.684610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977f41a-bf5f-4aa0-814d-dec1b2621722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:44.685465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977f41a-bf5f-4aa0-814d-dec1b2621722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:44.687519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977f41a-bf5f-4aa0-814d-dec1b2621722 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:44.699212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ac74d-0f6d-46a2-acc4-4c3934b0c72b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:44.708386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c2b79-d753-47d9-b6a4-564b515feecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:44.709122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c2b79-d753-47d9-b6a4-564b515feecb admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.709611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c2b79-d753-47d9-b6a4-564b515feecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.710016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c2b79-d753-47d9-b6a4-564b515feecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.710980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c2b79-d753-47d9-b6a4-564b515feecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:44.713089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c2b79-d753-47d9-b6a4-564b515feecb admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:44.719487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1127/2277] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:23:44.722799 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977f41a-bf5f-4aa0-814d-dec1b2621722 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:44.730170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1151/2278] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:44.734665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c2b79-d753-47d9-b6a4-564b515feecb admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:44.745573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977f41a-bf5f-4aa0-814d-dec1b2621722 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:44.753327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c2b79-d753-47d9-b6a4-564b515feecb admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:44.764336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88a085-0446-44ed-9fa1-952c9aa78680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:44.764726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a69860-52ec-4ca7-a4df-8f12adc05b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:44.765162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88a085-0446-44ed-9fa1-952c9aa78680 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.765442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a69860-52ec-4ca7-a4df-8f12adc05b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:44.765544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88a085-0446-44ed-9fa1-952c9aa78680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.765717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88a085-0446-44ed-9fa1-952c9aa78680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.765813 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a69860-52ec-4ca7-a4df-8f12adc05b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:44.766072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a69860-52ec-4ca7-a4df-8f12adc05b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:44.766582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88a085-0446-44ed-9fa1-952c9aa78680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:44.766743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a69860-52ec-4ca7-a4df-8f12adc05b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:44.769364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a69860-52ec-4ca7-a4df-8f12adc05b05 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:44.772660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88a085-0446-44ed-9fa1-952c9aa78680 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:44.801203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:44.813348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1128/2279] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:44 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:44.815940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a69860-52ec-4ca7-a4df-8f12adc05b05 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:44.855842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1152/2280] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:44.857342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88a085-0446-44ed-9fa1-952c9aa78680 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:44.894654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88a085-0446-44ed-9fa1-952c9aa78680 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:44.986431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a69860-52ec-4ca7-a4df-8f12adc05b05 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:45.000769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e689db-d324-4a12-ba1c-98b7bf66d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:45.001911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e689db-d324-4a12-ba1c-98b7bf66d4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.002830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e689db-d324-4a12-ba1c-98b7bf66d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.003692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e689db-d324-4a12-ba1c-98b7bf66d4f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.004884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e689db-d324-4a12-ba1c-98b7bf66d4f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:45.009277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e689db-d324-4a12-ba1c-98b7bf66d4f0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:45.018642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6af878-c1db-4f94-9ce0-d80e05542c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:45.019879 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af878-c1db-4f94-9ce0-d80e05542c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.020406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af878-c1db-4f94-9ce0-d80e05542c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.020833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af878-c1db-4f94-9ce0-d80e05542c9f admin admin] PATH_INFO: `/v3/projects/72274a65e00d4045a98e6c54fa56ec8a/users/ed09291d90d44ed782fcf8b36c51011e/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.067392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1129/2281] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:44 2022] POST /identity/v3/users => generated 288 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:45.068723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e689db-d324-4a12-ba1c-98b7bf66d4f0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:45.073543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6af878-c1db-4f94-9ce0-d80e05542c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72274a65e00d4045a98e6c54fa56ec8a, user_id=ed09291d90d44ed782fcf8b36c51011e, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:45.079207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6af878-c1db-4f94-9ce0-d80e05542c9f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:45.093975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e689db-d324-4a12-ba1c-98b7bf66d4f0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:45.106722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebf13e-baf8-493e-a040-f36fcca90096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:45.107797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebf13e-baf8-493e-a040-f36fcca90096 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.108079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebf13e-baf8-493e-a040-f36fcca90096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.108354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebf13e-baf8-493e-a040-f36fcca90096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.109049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebf13e-baf8-493e-a040-f36fcca90096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:45.110705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebf13e-baf8-493e-a040-f36fcca90096 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:45.132072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1153/2282] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:44 2022] PUT /identity/v3/projects/72274a65e00d4045a98e6c54fa56ec8a/users/ed09291d90d44ed782fcf8b36c51011e/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:45.145614 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1130/2283] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:45.149274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860b96c-8902-4518-964c-6e9cef18ed17 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.149780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860b96c-8902-4518-964c-6e9cef18ed17 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.150069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860b96c-8902-4518-964c-6e9cef18ed17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.152939 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebf13e-baf8-493e-a040-f36fcca90096 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:45.169354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebf13e-baf8-493e-a040-f36fcca90096 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:45.203773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-c860b96c-8902-4518-964c-6e9cef18ed17 None None] MFA Rules not processed for user `ed09291d90d44ed782fcf8b36c51011e`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:45.205222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c860b96c-8902-4518-964c-6e9cef18ed17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:45.285433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1154/2284] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:45.293201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860b96c-8902-4518-964c-6e9cef18ed17 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:45.300450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:45.325079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276290fc-f803-4ef2-af54-c92742215ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:45.325824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276290fc-f803-4ef2-af54-c92742215ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.326090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276290fc-f803-4ef2-af54-c92742215ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.326490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276290fc-f803-4ef2-af54-c92742215ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.327152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276290fc-f803-4ef2-af54-c92742215ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:45.328801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276290fc-f803-4ef2-af54-c92742215ef9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:45.354670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1131/2285] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:45.356380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276290fc-f803-4ef2-af54-c92742215ef9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:45.378944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276290fc-f803-4ef2-af54-c92742215ef9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:45.395776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51086d-7b7d-496f-beab-f736aa8f128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:45.396464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51086d-7b7d-496f-beab-f736aa8f128d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.396748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51086d-7b7d-496f-beab-f736aa8f128d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.397026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51086d-7b7d-496f-beab-f736aa8f128d admin admin] PATH_INFO: `/v3/projects/3386f5726cef4f0ab5f2d852cba77a38/users/e6c4a2933bb641f78aad2b51f55ef840/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.400076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860b96c-8902-4518-964c-6e9cef18ed17 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:45.405943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60263787-21c8-46a0-a320-60186d585d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:45.406573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60263787-21c8-46a0-a320-60186d585d18 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.406864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60263787-21c8-46a0-a320-60186d585d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.407390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60263787-21c8-46a0-a320-60186d585d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.408002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60263787-21c8-46a0-a320-60186d585d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:45.410058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60263787-21c8-46a0-a320-60186d585d18 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:45.431214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51086d-7b7d-496f-beab-f736aa8f128d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3386f5726cef4f0ab5f2d852cba77a38, user_id=e6c4a2933bb641f78aad2b51f55ef840, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:45.436979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51086d-7b7d-496f-beab-f736aa8f128d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:45.450041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:45.467771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1155/2286] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:45 2022] POST /identity/v3/projects => generated 391 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:45.475337 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60263787-21c8-46a0-a320-60186d585d18 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:45.478129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1132/2287] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:45 2022] PUT /identity/v3/projects/3386f5726cef4f0ab5f2d852cba77a38/users/e6c4a2933bb641f78aad2b51f55ef840/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:45.489396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd676f4-4b34-4b6f-ad54-31bc26715cb4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.489684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd676f4-4b34-4b6f-ad54-31bc26715cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.489961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd676f4-4b34-4b6f-ad54-31bc26715cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.542612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9dd676f4-4b34-4b6f-ad54-31bc26715cb4 None None] MFA Rules not processed for user `e6c4a2933bb641f78aad2b51f55ef840`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:45.548405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9dd676f4-4b34-4b6f-ad54-31bc26715cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:45.640648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60263787-21c8-46a0-a320-60186d585d18 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:45.647057 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37e9d0-3789-414d-b69e-badc7034500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:45.648251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37e9d0-3789-414d-b69e-badc7034500b admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.648557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37e9d0-3789-414d-b69e-badc7034500b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.648888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37e9d0-3789-414d-b69e-badc7034500b admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.650386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37e9d0-3789-414d-b69e-badc7034500b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:45.653125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37e9d0-3789-414d-b69e-badc7034500b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:45.688856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1156/2288] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:45 2022] POST /identity/v3/users => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:45.695756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37e9d0-3789-414d-b69e-badc7034500b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:45.705135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1133/2289] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:45.711584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd676f4-4b34-4b6f-ad54-31bc26715cb4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:45.723458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37e9d0-3789-414d-b69e-badc7034500b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:45.732498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c52cf-850f-4a79-bc71-a8d0a158aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:45.733232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c52cf-850f-4a79-bc71-a8d0a158aa64 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.733541 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c52cf-850f-4a79-bc71-a8d0a158aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.733811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c52cf-850f-4a79-bc71-a8d0a158aa64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.734022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd676f4-4b34-4b6f-ad54-31bc26715cb4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:45.734542 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c52cf-850f-4a79-bc71-a8d0a158aa64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:45.736939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c52cf-850f-4a79-bc71-a8d0a158aa64 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:45.741849 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e467c-7e38-4b8c-b6fb-27c019120f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:45.742678 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e467c-7e38-4b8c-b6fb-27c019120f88 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.743164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e467c-7e38-4b8c-b6fb-27c019120f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.743773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e467c-7e38-4b8c-b6fb-27c019120f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.744851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e467c-7e38-4b8c-b6fb-27c019120f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:45.747495 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e467c-7e38-4b8c-b6fb-27c019120f88 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:45.773364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1157/2290] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:45.780640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c52cf-850f-4a79-bc71-a8d0a158aa64 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:45.797499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c52cf-850f-4a79-bc71-a8d0a158aa64 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:45.809152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1134/2291] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:45 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:45.809762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e467c-7e38-4b8c-b6fb-27c019120f88 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:45.825768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b6e7-d6cc-483a-83b5-cb7c44bb7a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:45.826654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b6e7-d6cc-483a-83b5-cb7c44bb7a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:45.826941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b6e7-d6cc-483a-83b5-cb7c44bb7a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:45.827534 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b6e7-d6cc-483a-83b5-cb7c44bb7a7d admin admin] PATH_INFO: `/v3/projects/5f6ce65473ca4df79c5923d2f27761ae/users/e116c06e322a443d89f1b799aad0b3d8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:45.861885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611b6e7-d6cc-483a-83b5-cb7c44bb7a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6ce65473ca4df79c5923d2f27761ae, user_id=e116c06e322a443d89f1b799aad0b3d8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:45.873252 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611b6e7-d6cc-483a-83b5-cb7c44bb7a7d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:45.908089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1158/2292] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:45 2022] PUT /identity/v3/projects/5f6ce65473ca4df79c5923d2f27761ae/users/e116c06e322a443d89f1b799aad0b3d8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:45.909179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b6e7-d6cc-483a-83b5-cb7c44bb7a7d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:45.973342 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e467c-7e38-4b8c-b6fb-27c019120f88 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:46.034061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:46.068875 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b6e7-d6cc-483a-83b5-cb7c44bb7a7d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:46.082372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded0a9b-96e6-4671-befd-54a185ffe5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:46.083648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded0a9b-96e6-4671-befd-54a185ffe5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.084019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded0a9b-96e6-4671-befd-54a185ffe5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.084365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded0a9b-96e6-4671-befd-54a185ffe5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.085211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded0a9b-96e6-4671-befd-54a185ffe5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:46.087308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded0a9b-96e6-4671-befd-54a185ffe5ce admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:46.103152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1159/2293] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:46.118318 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded0a9b-96e6-4671-befd-54a185ffe5ce admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:46.129107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b342a7e-a118-44db-b55f-b869ee241309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:46.129760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b342a7e-a118-44db-b55f-b869ee241309 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.130215 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b342a7e-a118-44db-b55f-b869ee241309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.130481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b342a7e-a118-44db-b55f-b869ee241309 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.131449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b342a7e-a118-44db-b55f-b869ee241309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:46.138925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b342a7e-a118-44db-b55f-b869ee241309 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:46.143459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded0a9b-96e6-4671-befd-54a185ffe5ce admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:46.156882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f752865-8333-48a3-b5a2-97044d51d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:46.157666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f752865-8333-48a3-b5a2-97044d51d8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.158020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f752865-8333-48a3-b5a2-97044d51d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.158364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f752865-8333-48a3-b5a2-97044d51d8e8 admin admin] PATH_INFO: `/v3/projects/5f6ce65473ca4df79c5923d2f27761ae/users/e116c06e322a443d89f1b799aad0b3d8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.162026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f752865-8333-48a3-b5a2-97044d51d8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6ce65473ca4df79c5923d2f27761ae, user_id=e116c06e322a443d89f1b799aad0b3d8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:46.168805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f752865-8333-48a3-b5a2-97044d51d8e8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:46.207119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1160/2294] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:46 2022] PUT /identity/v3/projects/5f6ce65473ca4df79c5923d2f27761ae/users/e116c06e322a443d89f1b799aad0b3d8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:46.208820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408aa84-7aa2-4d87-902d-e5739af204c3 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.209478 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408aa84-7aa2-4d87-902d-e5739af204c3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.209478 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408aa84-7aa2-4d87-902d-e5739af204c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.218562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1135/2295] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:45 2022] POST /identity/v3/users => generated 293 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:46.224546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b342a7e-a118-44db-b55f-b869ee241309 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:46.246887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b342a7e-a118-44db-b55f-b869ee241309 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:46.247979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0408aa84-7aa2-4d87-902d-e5739af204c3 None None] MFA Rules not processed for user `e116c06e322a443d89f1b799aad0b3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:46.249654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0408aa84-7aa2-4d87-902d-e5739af204c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:46.282176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:46.381996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1161/2296] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:46.386439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601b83e-82c2-4604-8e33-a24512269101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:46.387331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601b83e-82c2-4604-8e33-a24512269101 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.388915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408aa84-7aa2-4d87-902d-e5739af204c3 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:46.389878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601b83e-82c2-4604-8e33-a24512269101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.390196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601b83e-82c2-4604-8e33-a24512269101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.391097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0408aa84-7aa2-4d87-902d-e5739af204c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:46.395766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601b83e-82c2-4604-8e33-a24512269101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:46.399426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601b83e-82c2-4604-8e33-a24512269101 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:46.427991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1136/2297] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:46.431441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601b83e-82c2-4604-8e33-a24512269101 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:46.452617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601b83e-82c2-4604-8e33-a24512269101 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:46.468714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab50345-2c35-4443-95b5-8731fed8d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:46.469402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab50345-2c35-4443-95b5-8731fed8d8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.469677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab50345-2c35-4443-95b5-8731fed8d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.469948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab50345-2c35-4443-95b5-8731fed8d8b0 admin admin] PATH_INFO: `/v3/projects/60fa8629ec7d4c328101d8200ec4ccdf/users/7c1156d382de4f40bda2e0a6e588d4c7/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.519829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab50345-2c35-4443-95b5-8731fed8d8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fa8629ec7d4c328101d8200ec4ccdf, user_id=7c1156d382de4f40bda2e0a6e588d4c7, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:46.528080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408aa84-7aa2-4d87-902d-e5739af204c3 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:46.532633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910f737-050e-480a-89f0-f155259e88f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:46.533382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab50345-2c35-4443-95b5-8731fed8d8b0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:46.533647 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f737-050e-480a-89f0-f155259e88f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.533936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f737-050e-480a-89f0-f155259e88f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.534210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f737-050e-480a-89f0-f155259e88f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.548827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910f737-050e-480a-89f0-f155259e88f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:46.550617 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910f737-050e-480a-89f0-f155259e88f4 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:46.564254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1162/2298] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:46.577976 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1137/2299] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:46 2022] PUT /identity/v3/projects/60fa8629ec7d4c328101d8200ec4ccdf/users/7c1156d382de4f40bda2e0a6e588d4c7/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:46.582725 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910f737-050e-480a-89f0-f155259e88f4 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:46.599906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910f737-050e-480a-89f0-f155259e88f4 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:46.633140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab50345-2c35-4443-95b5-8731fed8d8b0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:46.635628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1ab50345-2c35-4443-95b5-8731fed8d8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:46.753282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e5522-5e28-49c5-8de6-ce551dcba545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:46.754210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5522-5e28-49c5-8de6-ce551dcba545 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.754630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5522-5e28-49c5-8de6-ce551dcba545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.755190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5522-5e28-49c5-8de6-ce551dcba545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.757167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e5522-5e28-49c5-8de6-ce551dcba545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:46.758736 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e5522-5e28-49c5-8de6-ce551dcba545 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:46.786161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1163/2300] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:46.788101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e5522-5e28-49c5-8de6-ce551dcba545 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:46.792776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab50345-2c35-4443-95b5-8731fed8d8b0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:46.806643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37246b94-8226-4699-ad22-133a06641541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:46.807453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37246b94-8226-4699-ad22-133a06641541 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.807736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37246b94-8226-4699-ad22-133a06641541 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.808006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37246b94-8226-4699-ad22-133a06641541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.809900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e5522-5e28-49c5-8de6-ce551dcba545 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:46.825798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea54e1-1ae3-4e01-a8d6-ae0507b418c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:46.827955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea54e1-1ae3-4e01-a8d6-ae0507b418c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.828226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea54e1-1ae3-4e01-a8d6-ae0507b418c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.828553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea54e1-1ae3-4e01-a8d6-ae0507b418c0 admin admin] PATH_INFO: `/v3/projects/60fa8629ec7d4c328101d8200ec4ccdf/users/7c1156d382de4f40bda2e0a6e588d4c7/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.831197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea54e1-1ae3-4e01-a8d6-ae0507b418c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fa8629ec7d4c328101d8200ec4ccdf, user_id=7c1156d382de4f40bda2e0a6e588d4c7, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:46.843023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea54e1-1ae3-4e01-a8d6-ae0507b418c0 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:46.863132 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1164/2301] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:46 2022] PUT /identity/v3/projects/60fa8629ec7d4c328101d8200ec4ccdf/users/7c1156d382de4f40bda2e0a6e588d4c7/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:46.874028 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc8de-2be8-42d0-8522-7086ed4cd6f8 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:46.874373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc8de-2be8-42d0-8522-7086ed4cd6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:46.874742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc8de-2be8-42d0-8522-7086ed4cd6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:46.940701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:46.951747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-93edc8de-2be8-42d0-8522-7086ed4cd6f8 None None] MFA Rules not processed for user `7c1156d382de4f40bda2e0a6e588d4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:46.953076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-93edc8de-2be8-42d0-8522-7086ed4cd6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:46.975722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37246b94-8226-4699-ad22-133a06641541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:46.995533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37246b94-8226-4699-ad22-133a06641541 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:47.038866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1138/2302] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:47.039472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:47.137133 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1165/2303] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:47.145885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37246b94-8226-4699-ad22-133a06641541 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:47.161852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37246b94-8226-4699-ad22-133a06641541 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:47.296067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0a20a-e79a-4e43-b316-2a135beffd7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:47.296871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0a20a-e79a-4e43-b316-2a135beffd7f service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:47.297149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0a20a-e79a-4e43-b316-2a135beffd7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:47.297982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0a20a-e79a-4e43-b316-2a135beffd7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:47.388406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0a20a-e79a-4e43-b316-2a135beffd7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:47.392075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0a20a-e79a-4e43-b316-2a135beffd7f service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:47.406381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1139/2304] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:50.291954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edc8de-2be8-42d0-8522-7086ed4cd6f8 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:50.414351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edc8de-2be8-42d0-8522-7086ed4cd6f8 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:50.420332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:50.421099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:50.421481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:50.421855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] PATH_INFO: `/v3/users/e6c4a2933bb641f78aad2b51f55ef840` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:50.423122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c4a2933bb641f78aad2b51f55ef840)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:50.425468 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:50.500290 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c4a2933bb641f78aad2b51f55ef840'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:50.524243 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c4a2933bb641f78aad2b51f55ef840'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:50.534640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c4a2933bb641f78aad2b51f55ef840'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:50.537215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c4a2933bb641f78aad2b51f55ef840'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:50.542562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c4a2933bb641f78aad2b51f55ef840'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:50.581511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1166/2305] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:50 2022] DELETE /identity/v3/users/e6c4a2933bb641f78aad2b51f55ef840 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:50.585827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d42ef-b294-4ed7-a2c6-39c4fa2b5889 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:50.586359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d42ef-b294-4ed7-a2c6-39c4fa2b5889 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:50.586359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d42ef-b294-4ed7-a2c6-39c4fa2b5889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:50.607085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d55d42ef-b294-4ed7-a2c6-39c4fa2b5889 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:50.608419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d55d42ef-b294-4ed7-a2c6-39c4fa2b5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:50.711106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1140/2306] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:50.741964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:50.744121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:50.881019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6adea1-6d11-43db-ac11-fdc5f1a22667 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:50.885513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa97032-8548-42b8-b242-6b5047cb9164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:50.886599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa97032-8548-42b8-b242-6b5047cb9164 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:50.887067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa97032-8548-42b8-b242-6b5047cb9164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:50.887526 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa97032-8548-42b8-b242-6b5047cb9164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:50.895316 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:50.913492 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa97032-8548-42b8-b242-6b5047cb9164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:50.915625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa97032-8548-42b8-b242-6b5047cb9164 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:50.929079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1167/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:51.268960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d42ef-b294-4ed7-a2c6-39c4fa2b5889 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:51.270428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d55d42ef-b294-4ed7-a2c6-39c4fa2b5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:51.284052 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d42ef-b294-4ed7-a2c6-39c4fa2b5889 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:51.290082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:51.290761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:51.291352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:51.291468 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] PATH_INFO: `/v3/users/ed09291d90d44ed782fcf8b36c51011e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:51.292642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed09291d90d44ed782fcf8b36c51011e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:51.294640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:51.364264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:51.387277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed09291d90d44ed782fcf8b36c51011e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:51.411906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed09291d90d44ed782fcf8b36c51011e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:51.434685 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed09291d90d44ed782fcf8b36c51011e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:51.435515 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed09291d90d44ed782fcf8b36c51011e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:51.436581 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed09291d90d44ed782fcf8b36c51011e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:51.473890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1141/2308] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:51 2022] DELETE /identity/v3/users/ed09291d90d44ed782fcf8b36c51011e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:51.479617 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521926-3be7-4ce1-a8d9-32eb82454676 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:51.480175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521926-3be7-4ce1-a8d9-32eb82454676 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:51.480175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521926-3be7-4ce1-a8d9-32eb82454676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:51.510244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f8521926-3be7-4ce1-a8d9-32eb82454676 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:51.511744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f8521926-3be7-4ce1-a8d9-32eb82454676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:51.619618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1168/2309] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:51.631309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:51.633449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:51.726682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3536b66-257e-47a8-ba1e-5aabe3316a5d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:51.732382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813c457-728f-46d8-8ea7-674b0b152212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:51.732806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813c457-728f-46d8-8ea7-674b0b152212 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:51.733075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813c457-728f-46d8-8ea7-674b0b152212 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:51.733408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813c457-728f-46d8-8ea7-674b0b152212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:51.753011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8521926-3be7-4ce1-a8d9-32eb82454676 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:51.755465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f8521926-3be7-4ce1-a8d9-32eb82454676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:51.756258 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813c457-728f-46d8-8ea7-674b0b152212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:51.758130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813c457-728f-46d8-8ea7-674b0b152212 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:51.784014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8521926-3be7-4ce1-a8d9-32eb82454676 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:51.792917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1142/2310] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:51.797865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f14be7-3b38-4f4a-b115-f5a3d2ed1f4f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:51.797865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f14be7-3b38-4f4a-b115-f5a3d2ed1f4f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:51.802589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f14be7-3b38-4f4a-b115-f5a3d2ed1f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:51.804423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:51.805753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:51.806269 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:51.806741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] PATH_INFO: `/v3/projects/3386f5726cef4f0ab5f2d852cba77a38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:51.808404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3386f5726cef4f0ab5f2d852cba77a38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:51.812799 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:51.849420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e9f14be7-3b38-4f4a-b115-f5a3d2ed1f4f None None] MFA Rules not processed for user `4b2683d66665426e8a60614971b04bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:51.852459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e9f14be7-3b38-4f4a-b115-f5a3d2ed1f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:51.926163 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3386f5726cef4f0ab5f2d852cba77a38', 'request_id': 'req-8c87990b-a58b-413c-9d7a-17628267fb61'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:51.943952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3386f5726cef4f0ab5f2d852cba77a38', 'request_id': 'req-8c87990b-a58b-413c-9d7a-17628267fb61'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:51.953672 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3386f5726cef4f0ab5f2d852cba77a38', 'request_id': 'req-8c87990b-a58b-413c-9d7a-17628267fb61'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:51.978011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] The token cache is being invalidate because project 3386f5726cef4f0ab5f2d852cba77a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:51.978144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:51.981377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:51.985793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1169/2311] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:51 2022] DELETE /identity/v3/projects/3386f5726cef4f0ab5f2d852cba77a38 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:51.990698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:51.993680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:52.038252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1143/2312] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:52.043230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f14be7-3b38-4f4a-b115-f5a3d2ed1f4f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:52.044925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e9f14be7-3b38-4f4a-b115-f5a3d2ed1f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:52.062444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f14be7-3b38-4f4a-b115-f5a3d2ed1f4f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:52.138566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87990b-a58b-413c-9d7a-17628267fb61 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:52.144152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:52.158534 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:52.159429 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:52.159626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:52.159892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] PATH_INFO: `/v3/users/7c1156d382de4f40bda2e0a6e588d4c7` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:52.161172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1156d382de4f40bda2e0a6e588d4c7)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:52.163156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:52.185244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c660-74c9-441f-b447-83e2c7505637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:52.186014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c660-74c9-441f-b447-83e2c7505637 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:52.186395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c660-74c9-441f-b447-83e2c7505637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:52.186679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c660-74c9-441f-b447-83e2c7505637 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:52.187361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c660-74c9-441f-b447-83e2c7505637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:52.189390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c660-74c9-441f-b447-83e2c7505637 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:52.220776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:52.283471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1144/2313] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:52 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:23:52.287710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c660-74c9-441f-b447-83e2c7505637 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:52.304031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1156d382de4f40bda2e0a6e588d4c7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.342760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1156d382de4f40bda2e0a6e588d4c7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.353437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1156d382de4f40bda2e0a6e588d4c7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.354360 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1156d382de4f40bda2e0a6e588d4c7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.355164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1156d382de4f40bda2e0a6e588d4c7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.376475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1170/2314] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:51 2022] DELETE /identity/v3/users/7c1156d382de4f40bda2e0a6e588d4c7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:52.377406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:52.378853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:52.430078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c660-74c9-441f-b447-83e2c7505637 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:52.491287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f091d96-c556-4392-9a3f-58cda8f7538b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:52.498507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:52.499639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:52.500224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:52.500224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] PATH_INFO: `/v3/projects/72274a65e00d4045a98e6c54fa56ec8a` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:52.501459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72274a65e00d4045a98e6c54fa56ec8a)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:52.503528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:52.508154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e19252-db4c-420b-b152-5b567a7bd3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:52.509191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e19252-db4c-420b-b152-5b567a7bd3ff admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:52.509481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e19252-db4c-420b-b152-5b567a7bd3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:52.509786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e19252-db4c-420b-b152-5b567a7bd3ff admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:52.510450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e19252-db4c-420b-b152-5b567a7bd3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:52.512643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e19252-db4c-420b-b152-5b567a7bd3ff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:52.553873 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1145/2315] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:52 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:52.556863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e19252-db4c-420b-b152-5b567a7bd3ff admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:52.569437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72274a65e00d4045a98e6c54fa56ec8a', 'request_id': 'req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.578306 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-35e19252-db4c-420b-b152-5b567a7bd3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:52.582286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72274a65e00d4045a98e6c54fa56ec8a', 'request_id': 'req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.596913 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72274a65e00d4045a98e6c54fa56ec8a', 'request_id': 'req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.601701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e19252-db4c-420b-b152-5b567a7bd3ff admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:52.627622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] The token cache is being invalidate because project 72274a65e00d4045a98e6c54fa56ec8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:52.627941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.629644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.631562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1171/2316] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:52 2022] DELETE /identity/v3/projects/72274a65e00d4045a98e6c54fa56ec8a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:52.641108 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:52.642763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:52.691175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638306-6069-45d8-aa02-657d1968c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:52.692044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638306-6069-45d8-aa02-657d1968c9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:52.692331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638306-6069-45d8-aa02-657d1968c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:52.692668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638306-6069-45d8-aa02-657d1968c9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:52.693462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31638306-6069-45d8-aa02-657d1968c9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:52.695233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31638306-6069-45d8-aa02-657d1968c9b0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:52.707657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1146/2317] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:52.711002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:52.711764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638306-6069-45d8-aa02-657d1968c9b0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:52.713972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-31638306-6069-45d8-aa02-657d1968c9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:52.724037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:52.729235 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638306-6069-45d8-aa02-657d1968c9b0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:52.741916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa705a4-237c-4e92-9353-50d0ddffae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:52.742610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa705a4-237c-4e92-9353-50d0ddffae03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:52.742892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa705a4-237c-4e92-9353-50d0ddffae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:52.743201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa705a4-237c-4e92-9353-50d0ddffae03 admin admin] PATH_INFO: `/v3/projects/f251b50bc93146fd97b220907dfeaf84/users/2aaaf9e14852450bb994c8465029c9ad/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:52.766498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845579b-fdb8-46c7-9c09-9030ba2d3fe9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:52.776090 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa705a4-237c-4e92-9353-50d0ddffae03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f251b50bc93146fd97b220907dfeaf84, user_id=2aaaf9e14852450bb994c8465029c9ad, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:52.776356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:52.777115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:52.777474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:52.777717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] PATH_INFO: `/v3/users/e116c06e322a443d89f1b799aad0b3d8` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:52.778771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa705a4-237c-4e92-9353-50d0ddffae03 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:52.779008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e116c06e322a443d89f1b799aad0b3d8)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:52.781241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:52.800530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1147/2318] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:52 2022] PUT /identity/v3/projects/f251b50bc93146fd97b220907dfeaf84/users/2aaaf9e14852450bb994c8465029c9ad/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:52.800530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa705a4-237c-4e92-9353-50d0ddffae03 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:52.803849 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-caa705a4-237c-4e92-9353-50d0ddffae03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:52.873879 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e116c06e322a443d89f1b799aad0b3d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.898379 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e116c06e322a443d89f1b799aad0b3d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.911551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e116c06e322a443d89f1b799aad0b3d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.913231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e116c06e322a443d89f1b799aad0b3d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.914313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e116c06e322a443d89f1b799aad0b3d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:52.930236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa705a4-237c-4e92-9353-50d0ddffae03 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:52.941196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1172/2319] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:23:52 2022] DELETE /identity/v3/users/e116c06e322a443d89f1b799aad0b3d8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:52.941399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:52.942429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:52.942575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:52.942676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:52.942764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] PATH_INFO: `/v3/projects/60fa8629ec7d4c328101d8200ec4ccdf` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:52.944773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:52.948356 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fa8629ec7d4c328101d8200ec4ccdf)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:52.950355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:53.041919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fa8629ec7d4c328101d8200ec4ccdf', 'request_id': 'req-20c753ca-dc5c-44bc-beab-5c27f57e3bac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:53.058226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fa8629ec7d4c328101d8200ec4ccdf', 'request_id': 'req-20c753ca-dc5c-44bc-beab-5c27f57e3bac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:53.083218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fa8629ec7d4c328101d8200ec4ccdf', 'request_id': 'req-20c753ca-dc5c-44bc-beab-5c27f57e3bac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:53.087778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e82f2e-766b-4dd7-959f-ac709cc36193 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:53.107105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] The token cache is being invalidate because project 60fa8629ec7d4c328101d8200ec4ccdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:53.108315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:53.109409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-20c753ca-dc5c-44bc-beab-5c27f57e3bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:53.114185 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1148/2320] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:52 2022] DELETE /identity/v3/projects/60fa8629ec7d4c328101d8200ec4ccdf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:53.119345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50808-674e-44c9-89a7-8da168c33667 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:53.119815 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50808-674e-44c9-89a7-8da168c33667 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:53.120229 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50808-674e-44c9-89a7-8da168c33667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:53.148606 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bcc50808-674e-44c9-89a7-8da168c33667 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:53.149992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bcc50808-674e-44c9-89a7-8da168c33667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:53.162723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:53.178494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a50274-a9fb-4d90-a4e9-852e398358cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:53.179399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a50274-a9fb-4d90-a4e9-852e398358cc admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:53.180375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a50274-a9fb-4d90-a4e9-852e398358cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:53.180701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a50274-a9fb-4d90-a4e9-852e398358cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:53.181390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a50274-a9fb-4d90-a4e9-852e398358cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:53.185412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a50274-a9fb-4d90-a4e9-852e398358cc admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:53.206514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1173/2321] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:53.210820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a50274-a9fb-4d90-a4e9-852e398358cc admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:53.217078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-36a50274-a9fb-4d90-a4e9-852e398358cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:53.242267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a50274-a9fb-4d90-a4e9-852e398358cc admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:53.252951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c451943-821d-44c4-8980-e86b2323fd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:53.254339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c451943-821d-44c4-8980-e86b2323fd58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:53.254863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c451943-821d-44c4-8980-e86b2323fd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:53.255201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c451943-821d-44c4-8980-e86b2323fd58 admin admin] PATH_INFO: `/v3/projects/f251b50bc93146fd97b220907dfeaf84/users/2aaaf9e14852450bb994c8465029c9ad/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:53.258595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c451943-821d-44c4-8980-e86b2323fd58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f251b50bc93146fd97b220907dfeaf84, user_id=2aaaf9e14852450bb994c8465029c9ad, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:53.268878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c451943-821d-44c4-8980-e86b2323fd58 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:53.287442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1174/2322] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:53 2022] PUT /identity/v3/projects/f251b50bc93146fd97b220907dfeaf84/users/2aaaf9e14852450bb994c8465029c9ad/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:53.315956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631f77d-5edd-4e4e-a17f-c4b128e702ea None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:53.316265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1149/2323] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:53.316378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631f77d-5edd-4e4e-a17f-c4b128e702ea None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:53.316727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631f77d-5edd-4e4e-a17f-c4b128e702ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:53.373338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2631f77d-5edd-4e4e-a17f-c4b128e702ea None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:53.374690 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2631f77d-5edd-4e4e-a17f-c4b128e702ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:53.487513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1175/2324] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:53.492454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50808-674e-44c9-89a7-8da168c33667 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:53.508005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50808-674e-44c9-89a7-8da168c33667 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:53.533091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73b60c-85d7-444d-850b-37a66fb67448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:53.533820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73b60c-85d7-444d-850b-37a66fb67448 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:53.534216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73b60c-85d7-444d-850b-37a66fb67448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:53.534554 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73b60c-85d7-444d-850b-37a66fb67448 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:53.535689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73b60c-85d7-444d-850b-37a66fb67448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:53.537657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73b60c-85d7-444d-850b-37a66fb67448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:53.541205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73b60c-85d7-444d-850b-37a66fb67448 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:53.567108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:53.592379 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1150/2325] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:53.595047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631f77d-5edd-4e4e-a17f-c4b128e702ea None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:53.595618 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73b60c-85d7-444d-850b-37a66fb67448 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:53.597584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8c73b60c-85d7-444d-850b-37a66fb67448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:53.609490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631f77d-5edd-4e4e-a17f-c4b128e702ea None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:53.621788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3f022-6da2-4ff7-8cc0-3ee16f507234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:53.622489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3f022-6da2-4ff7-8cc0-3ee16f507234 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:53.622773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3f022-6da2-4ff7-8cc0-3ee16f507234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:53.623052 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3f022-6da2-4ff7-8cc0-3ee16f507234 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:53.623770 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3f022-6da2-4ff7-8cc0-3ee16f507234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:53.625440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73b60c-85d7-444d-850b-37a66fb67448 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:53.630250 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3f022-6da2-4ff7-8cc0-3ee16f507234 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:53.641013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:53.641988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:53.643907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:53.643907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] PATH_INFO: `/v3/projects/5f6ce65473ca4df79c5923d2f27761ae` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:53.644687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6ce65473ca4df79c5923d2f27761ae)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:53.647624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:53.692501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1176/2326] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:53 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:53.696259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3f022-6da2-4ff7-8cc0-3ee16f507234 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:53.762430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6ce65473ca4df79c5923d2f27761ae', 'request_id': 'req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:53.778311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6ce65473ca4df79c5923d2f27761ae', 'request_id': 'req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:53.799352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6ce65473ca4df79c5923d2f27761ae', 'request_id': 'req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:53.827403 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] The token cache is being invalidate because project 5f6ce65473ca4df79c5923d2f27761ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:23:53.827752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:53.829143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-862ac972-0d7e-4a24-82b4-ba023dbd8cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:23:53.834317 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1151/2327] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:23:53 2022] DELETE /identity/v3/projects/5f6ce65473ca4df79c5923d2f27761ae => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:53.836595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24722-67fb-4ea7-bc06-cf24e435adef None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:53.836595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24722-67fb-4ea7-bc06-cf24e435adef None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:53.836944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24722-67fb-4ea7-bc06-cf24e435adef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:53.842723 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3f022-6da2-4ff7-8cc0-3ee16f507234 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:53.878785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-99b24722-67fb-4ea7-bc06-cf24e435adef None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:53.880392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-99b24722-67fb-4ea7-bc06-cf24e435adef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:53.950732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f4635-b546-478f-b8b1-c639ffaa6bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:53.951556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f4635-b546-478f-b8b1-c639ffaa6bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:53.951931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f4635-b546-478f-b8b1-c639ffaa6bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:53.952280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f4635-b546-478f-b8b1-c639ffaa6bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:53.953308 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f4635-b546-478f-b8b1-c639ffaa6bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:53.955697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f4635-b546-478f-b8b1-c639ffaa6bc9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:53.967644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:53.997958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1177/2328] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:53 2022] POST /identity/v3/users => generated 286 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:53.999266 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f4635-b546-478f-b8b1-c639ffaa6bc9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:54.002107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-639f4635-b546-478f-b8b1-c639ffaa6bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:54.029287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f4635-b546-478f-b8b1-c639ffaa6bc9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:54.035386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1152/2329] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:54.037174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d95cf-8c21-4c46-859f-c428235f37cf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.037507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d95cf-8c21-4c46-859f-c428235f37cf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.037807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d95cf-8c21-4c46-859f-c428235f37cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.046595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63d865-3405-4eee-80fa-f26bb735434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:54.049597 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63d865-3405-4eee-80fa-f26bb735434e admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.050137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63d865-3405-4eee-80fa-f26bb735434e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.050459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63d865-3405-4eee-80fa-f26bb735434e admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.051952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63d865-3405-4eee-80fa-f26bb735434e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:54.058118 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63d865-3405-4eee-80fa-f26bb735434e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:54.082032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1178/2330] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:54.095137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63d865-3405-4eee-80fa-f26bb735434e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:54.100786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-323d95cf-8c21-4c46-859f-c428235f37cf None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:54.104124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-323d95cf-8c21-4c46-859f-c428235f37cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:54.126102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63d865-3405-4eee-80fa-f26bb735434e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:54.127598 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1153/2331] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:54.132167 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d95cf-8c21-4c46-859f-c428235f37cf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:54.138324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decf4c3-ccbd-4233-af9f-804c79928e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:54.139012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decf4c3-ccbd-4233-af9f-804c79928e54 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.139222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decf4c3-ccbd-4233-af9f-804c79928e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.142101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decf4c3-ccbd-4233-af9f-804c79928e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.142922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decf4c3-ccbd-4233-af9f-804c79928e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:54.144722 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decf4c3-ccbd-4233-af9f-804c79928e54 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:54.155240 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d95cf-8c21-4c46-859f-c428235f37cf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:54.167029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881cf9d-199e-4d3a-bab3-d733099a2927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:54.167029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881cf9d-199e-4d3a-bab3-d733099a2927 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.167198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881cf9d-199e-4d3a-bab3-d733099a2927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.167592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881cf9d-199e-4d3a-bab3-d733099a2927 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.171124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881cf9d-199e-4d3a-bab3-d733099a2927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:23:54.171541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881cf9d-199e-4d3a-bab3-d733099a2927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:54.179049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1179/2332] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:54.184386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881cf9d-199e-4d3a-bab3-d733099a2927 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:54.184750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decf4c3-ccbd-4233-af9f-804c79928e54 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:54.217572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decf4c3-ccbd-4233-af9f-804c79928e54 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:54.231470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cb4af-9311-4f8c-8197-ca079f61d2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:54.233759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb4af-9311-4f8c-8197-ca079f61d2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.238215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb4af-9311-4f8c-8197-ca079f61d2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.238790 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1154/2333] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:23:54.239087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb4af-9311-4f8c-8197-ca079f61d2c6 admin admin] PATH_INFO: `/v3/projects/ff93fc6af50a4160bbcf5cd7bcbc0553/users/721a847d76a840fcb9681ddee0a374f1/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.239841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881cf9d-199e-4d3a-bab3-d733099a2927 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:54.252519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881cf9d-199e-4d3a-bab3-d733099a2927 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:54.257481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6b765-781c-4a50-a1eb-170b7d9c71bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:54.258327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6b765-781c-4a50-a1eb-170b7d9c71bc admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.258450 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6b765-781c-4a50-a1eb-170b7d9c71bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.258829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6b765-781c-4a50-a1eb-170b7d9c71bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.259613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6b765-781c-4a50-a1eb-170b7d9c71bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:54.262482 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6b765-781c-4a50-a1eb-170b7d9c71bc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:54.289158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cb4af-9311-4f8c-8197-ca079f61d2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff93fc6af50a4160bbcf5cd7bcbc0553, user_id=721a847d76a840fcb9681ddee0a374f1, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:54.307109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1155/2334] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:54 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:54.309747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6b765-781c-4a50-a1eb-170b7d9c71bc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:54.310419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cb4af-9311-4f8c-8197-ca079f61d2c6 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:54.340508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1180/2335] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:54 2022] PUT /identity/v3/projects/ff93fc6af50a4160bbcf5cd7bcbc0553/users/721a847d76a840fcb9681ddee0a374f1/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:54.353810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d401bb-76a4-48dc-a4bc-e79664249445 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.354178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d401bb-76a4-48dc-a4bc-e79664249445 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.354419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d401bb-76a4-48dc-a4bc-e79664249445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.420858 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-86d401bb-76a4-48dc-a4bc-e79664249445 None None] MFA Rules not processed for user `721a847d76a840fcb9681ddee0a374f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:54.422212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:54.422332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-86d401bb-76a4-48dc-a4bc-e79664249445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:54.481777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6b765-781c-4a50-a1eb-170b7d9c71bc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:54.596015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1181/2336] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:54.611338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d401bb-76a4-48dc-a4bc-e79664249445 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:54.614622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-86d401bb-76a4-48dc-a4bc-e79664249445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:54.717387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a326e6-e01f-442b-ac56-001ddaf10769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:54.718194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a326e6-e01f-442b-ac56-001ddaf10769 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.718483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a326e6-e01f-442b-ac56-001ddaf10769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.718747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a326e6-e01f-442b-ac56-001ddaf10769 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.720878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a326e6-e01f-442b-ac56-001ddaf10769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:54.740220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a326e6-e01f-442b-ac56-001ddaf10769 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:54.824481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1156/2337] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:54 2022] POST /identity/v3/users => generated 300 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:54.825119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d401bb-76a4-48dc-a4bc-e79664249445 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:54.825828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a326e6-e01f-442b-ac56-001ddaf10769 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:54.833193 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbb54b-7e87-4429-b334-36cdb9ab0b6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54131719962e4463b0b874916cb40973', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:54.834837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb54b-7e87-4429-b334-36cdb9ab0b6e service glance] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.834837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb54b-7e87-4429-b334-36cdb9ab0b6e service glance] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.834837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb54b-7e87-4429-b334-36cdb9ab0b6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.843286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a326e6-e01f-442b-ac56-001ddaf10769 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:54.848248 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0e544-df34-4c68-ad6e-1df891b1c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:54.849188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0e544-df34-4c68-ad6e-1df891b1c444 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.849662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0e544-df34-4c68-ad6e-1df891b1c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.849941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0e544-df34-4c68-ad6e-1df891b1c444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.850599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0e544-df34-4c68-ad6e-1df891b1c444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:54.855293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0e544-df34-4c68-ad6e-1df891b1c444 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:54.877997 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1157/2338] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:23:54.879591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbb54b-7e87-4429-b334-36cdb9ab0b6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:54.882084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0e544-df34-4c68-ad6e-1df891b1c444 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:54.883178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbb54b-7e87-4429-b334-36cdb9ab0b6e service glance] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:54.904146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1182/2339] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:54.926675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0e544-df34-4c68-ad6e-1df891b1c444 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:54.938988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d746e64-0c17-4072-854b-10c34c1376e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:54.945801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746e64-0c17-4072-854b-10c34c1376e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:54.946179 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746e64-0c17-4072-854b-10c34c1376e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:54.946774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746e64-0c17-4072-854b-10c34c1376e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:54.949496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d746e64-0c17-4072-854b-10c34c1376e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:54.951167 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d746e64-0c17-4072-854b-10c34c1376e7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:55.002628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1158/2340] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:55.003914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbb54b-7e87-4429-b334-36cdb9ab0b6e service glance] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:55.021546 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbb54b-7e87-4429-b334-36cdb9ab0b6e service glance] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:55.059582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcdad7-9355-433e-8a13-c5a4403db95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:55.068854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcdad7-9355-433e-8a13-c5a4403db95b admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:55.069218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcdad7-9355-433e-8a13-c5a4403db95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:55.069500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcdad7-9355-433e-8a13-c5a4403db95b admin admin] PATH_INFO: `/v3/projects/af610babba3f4d889d310be096401e94/users/acce7790defb42c99a0ea82c096fd91e/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:55.108276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcdad7-9355-433e-8a13-c5a4403db95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af610babba3f4d889d310be096401e94, user_id=acce7790defb42c99a0ea82c096fd91e, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:55.110963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcdad7-9355-433e-8a13-c5a4403db95b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:55.154088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eb6c8-7a1b-4cad-b09d-245499285adb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:55.154650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eb6c8-7a1b-4cad-b09d-245499285adb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:55.155198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eb6c8-7a1b-4cad-b09d-245499285adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:55.161593 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1183/2341] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:55 2022] PUT /identity/v3/projects/af610babba3f4d889d310be096401e94/users/acce7790defb42c99a0ea82c096fd91e/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:55.218643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-092eb6c8-7a1b-4cad-b09d-245499285adb None None] MFA Rules not processed for user `acce7790defb42c99a0ea82c096fd91e`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:55.219916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-092eb6c8-7a1b-4cad-b09d-245499285adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:55.400885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1159/2342] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:23:55.405785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcdad7-9355-433e-8a13-c5a4403db95b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:55.431724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:55.542724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcdad7-9355-433e-8a13-c5a4403db95b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:55.557633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2720af-b301-4fa0-bd04-c79869d0eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:55.558780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2720af-b301-4fa0-bd04-c79869d0eff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:55.559144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2720af-b301-4fa0-bd04-c79869d0eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:55.559334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2720af-b301-4fa0-bd04-c79869d0eff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:55.560717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2720af-b301-4fa0-bd04-c79869d0eff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:55.563102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2720af-b301-4fa0-bd04-c79869d0eff2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:55.654287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1184/2343] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:23:55 2022] POST /identity/v3/projects => generated 399 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:55.658367 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eb6c8-7a1b-4cad-b09d-245499285adb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:55.677149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eb6c8-7a1b-4cad-b09d-245499285adb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:55.795680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:55.820818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee8da-ab1f-4a0e-a776-3b11e14108c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:55.822014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee8da-ab1f-4a0e-a776-3b11e14108c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:55.822792 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee8da-ab1f-4a0e-a776-3b11e14108c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:55.823301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee8da-ab1f-4a0e-a776-3b11e14108c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:55.824155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fee8da-ab1f-4a0e-a776-3b11e14108c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:55.826599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fee8da-ab1f-4a0e-a776-3b11e14108c3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:55.876401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1160/2344] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:23:55 2022] POST /identity/v3/users => generated 306 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:23:55.889956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2720af-b301-4fa0-bd04-c79869d0eff2 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:55.901440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2720af-b301-4fa0-bd04-c79869d0eff2 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:55.913733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62469507-db95-4ed2-9e7d-c4e837bc8475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:55.914410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62469507-db95-4ed2-9e7d-c4e837bc8475 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:55.914689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62469507-db95-4ed2-9e7d-c4e837bc8475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:55.915057 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62469507-db95-4ed2-9e7d-c4e837bc8475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:55.915782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62469507-db95-4ed2-9e7d-c4e837bc8475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:55.917403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62469507-db95-4ed2-9e7d-c4e837bc8475 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:55.943599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1185/2345] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:55.947895 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee8da-ab1f-4a0e-a776-3b11e14108c3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:55.963911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee8da-ab1f-4a0e-a776-3b11e14108c3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:55.971893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cea16f-7db2-44a0-a6e5-8aa0494f0917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:55.973364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cea16f-7db2-44a0-a6e5-8aa0494f0917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:55.973783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cea16f-7db2-44a0-a6e5-8aa0494f0917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:55.975341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cea16f-7db2-44a0-a6e5-8aa0494f0917 admin admin] PATH_INFO: `/v3/projects/7a01586fa64e49858cd054e8402157a1/users/a399e56244ae4035b2b97c51e87799b8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:56.002819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cea16f-7db2-44a0-a6e5-8aa0494f0917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a01586fa64e49858cd054e8402157a1, user_id=a399e56244ae4035b2b97c51e87799b8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:56.005543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cea16f-7db2-44a0-a6e5-8aa0494f0917 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:56.032867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62469507-db95-4ed2-9e7d-c4e837bc8475 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:56.033295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1161/2346] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:55 2022] PUT /identity/v3/projects/7a01586fa64e49858cd054e8402157a1/users/a399e56244ae4035b2b97c51e87799b8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:56.043628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62469507-db95-4ed2-9e7d-c4e837bc8475 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:56.150920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc0b60-68e9-47e1-9396-9a9f2c8134f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:56.155471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc0b60-68e9-47e1-9396-9a9f2c8134f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:56.155801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc0b60-68e9-47e1-9396-9a9f2c8134f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:56.156797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc0b60-68e9-47e1-9396-9a9f2c8134f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:56.157158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc0b60-68e9-47e1-9396-9a9f2c8134f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:56.163435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc0b60-68e9-47e1-9396-9a9f2c8134f8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:56.217813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1186/2347] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:23:56.220900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cea16f-7db2-44a0-a6e5-8aa0494f0917 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:56.248244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cea16f-7db2-44a0-a6e5-8aa0494f0917 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:56.270724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af393d1-6586-43ed-be1c-81d6d3e12ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:56.271798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af393d1-6586-43ed-be1c-81d6d3e12ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:56.272361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af393d1-6586-43ed-be1c-81d6d3e12ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:56.272836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af393d1-6586-43ed-be1c-81d6d3e12ce4 admin admin] PATH_INFO: `/v3/projects/7a01586fa64e49858cd054e8402157a1/users/a399e56244ae4035b2b97c51e87799b8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:56.276430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af393d1-6586-43ed-be1c-81d6d3e12ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a01586fa64e49858cd054e8402157a1, user_id=a399e56244ae4035b2b97c51e87799b8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:56.295965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af393d1-6586-43ed-be1c-81d6d3e12ce4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:56.330519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1162/2348] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:23:56 2022] PUT /identity/v3/projects/7a01586fa64e49858cd054e8402157a1/users/a399e56244ae4035b2b97c51e87799b8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:23:56.341089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb868-e0f9-417c-ab75-59364c444ca6 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:56.341348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb868-e0f9-417c-ab75-59364c444ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:56.341447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb868-e0f9-417c-ab75-59364c444ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:56.411316 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b90eb868-e0f9-417c-ab75-59364c444ca6 None None] MFA Rules not processed for user `a399e56244ae4035b2b97c51e87799b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:23:56.412582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b90eb868-e0f9-417c-ab75-59364c444ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:56.627073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1187/2349] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:23:56.639336 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af393d1-6586-43ed-be1c-81d6d3e12ce4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:56.641670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8af393d1-6586-43ed-be1c-81d6d3e12ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:23:56.729600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af393d1-6586-43ed-be1c-81d6d3e12ce4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:56.733797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2169b1-71ee-44d2-ac68-e438e36fe244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:56.734547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2169b1-71ee-44d2-ac68-e438e36fe244 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:56.734902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2169b1-71ee-44d2-ac68-e438e36fe244 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:56.735241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2169b1-71ee-44d2-ac68-e438e36fe244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:56.751871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2169b1-71ee-44d2-ac68-e438e36fe244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:56.759822 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2169b1-71ee-44d2-ac68-e438e36fe244 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:56.780230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1163/2350] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:56 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:23:56.965331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eb868-e0f9-417c-ab75-59364c444ca6 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:23:56.982142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eb868-e0f9-417c-ab75-59364c444ca6 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:23:56.997962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75059754-73dd-4219-849e-9693180efc11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:23:56.998820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75059754-73dd-4219-849e-9693180efc11 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:23:56.999601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75059754-73dd-4219-849e-9693180efc11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:23:57.000628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75059754-73dd-4219-849e-9693180efc11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:23:57.033169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:23:57.153849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75059754-73dd-4219-849e-9693180efc11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:23:57.162370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75059754-73dd-4219-849e-9693180efc11 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:23:57.208606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1188/2351] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:23:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:24:01.733262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572ebb-ef81-4f21-a138-5160de53ebbf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:01.733959 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572ebb-ef81-4f21-a138-5160de53ebbf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:01.733959 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572ebb-ef81-4f21-a138-5160de53ebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:01.801697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b7572ebb-ef81-4f21-a138-5160de53ebbf None None] MFA Rules not processed for user `2aaaf9e14852450bb994c8465029c9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:01.803079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b7572ebb-ef81-4f21-a138-5160de53ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:01.928886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1164/2352] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:24:01.941365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75059754-73dd-4219-849e-9693180efc11 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:01.942949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-75059754-73dd-4219-849e-9693180efc11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:02.023125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75059754-73dd-4219-849e-9693180efc11 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:02.027487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7912a64-437c-43c9-b88b-be01b79f088b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54131719962e4463b0b874916cb40973', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:02.028169 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912a64-437c-43c9-b88b-be01b79f088b service glance] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:02.028544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912a64-437c-43c9-b88b-be01b79f088b service glance] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:02.028706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912a64-437c-43c9-b88b-be01b79f088b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:02.030574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e7912a64-437c-43c9-b88b-be01b79f088b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:02.115901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7912a64-437c-43c9-b88b-be01b79f088b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:02.117362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7912a64-437c-43c9-b88b-be01b79f088b service glance] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:02.131385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1189/2353] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:02.142027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572ebb-ef81-4f21-a138-5160de53ebbf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:02.172082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:02.242338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572ebb-ef81-4f21-a138-5160de53ebbf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:02.253649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:02.254672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:02.255490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:02.255839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] PATH_INFO: `/v3/users/acce7790defb42c99a0ea82c096fd91e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:02.257552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] RBAC: Authorizing `identity:delete_user(user_id=acce7790defb42c99a0ea82c096fd91e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:02.259802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:02.307072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca73f-0954-4703-ab5f-d53ba4ab2bcd None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:02.307454 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca73f-0954-4703-ab5f-d53ba4ab2bcd None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:02.307741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca73f-0954-4703-ab5f-d53ba4ab2bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:02.331191 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-314ca73f-0954-4703-ab5f-d53ba4ab2bcd None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:02.332437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-314ca73f-0954-4703-ab5f-d53ba4ab2bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:02.336719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acce7790defb42c99a0ea82c096fd91e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:02.354526 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acce7790defb42c99a0ea82c096fd91e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:02.363032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acce7790defb42c99a0ea82c096fd91e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:02.363868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acce7790defb42c99a0ea82c096fd91e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:02.364542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acce7790defb42c99a0ea82c096fd91e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:02.402605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1190/2354] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:02.405589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1165/2355] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:24:02 2022] DELETE /identity/v3/users/acce7790defb42c99a0ea82c096fd91e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:02.410202 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85d952-2c02-486f-81e5-d707f746b9cc None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:02.410490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85d952-2c02-486f-81e5-d707f746b9cc None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:02.410764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85d952-2c02-486f-81e5-d707f746b9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:02.429368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:02.432159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-9a85d952-2c02-486f-81e5-d707f746b9cc None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:02.433830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9a85d952-2c02-486f-81e5-d707f746b9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:02.461170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:02.463705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:02.502824 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1191/2356] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:02.511280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85d952-2c02-486f-81e5-d707f746b9cc None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:02.512757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9a85d952-2c02-486f-81e5-d707f746b9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:02.565176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941625e-c820-46db-978a-5ca1ad80114a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:02.570705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30c76b-a09d-4c4a-b110-61249d5d78ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:02.571635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c76b-a09d-4c4a-b110-61249d5d78ca service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:02.572029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c76b-a09d-4c4a-b110-61249d5d78ca service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:02.572293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30c76b-a09d-4c4a-b110-61249d5d78ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:02.590962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85d952-2c02-486f-81e5-d707f746b9cc None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:02.598381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3935d-9fa2-4483-a19c-34fb725948e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:02.599123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3935d-9fa2-4483-a19c-34fb725948e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:02.599431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3935d-9fa2-4483-a19c-34fb725948e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:02.599704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3935d-9fa2-4483-a19c-34fb725948e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:02.615531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3935d-9fa2-4483-a19c-34fb725948e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:02.618069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3935d-9fa2-4483-a19c-34fb725948e1 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:02.628661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1192/2357] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:24:02.631805 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:02.654181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30c76b-a09d-4c4a-b110-61249d5d78ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:02.656321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30c76b-a09d-4c4a-b110-61249d5d78ca service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:02.666398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1166/2358] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:24:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 03 01:24:03.166241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3935d-9fa2-4483-a19c-34fb725948e1 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:03.170949 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e6b3935d-9fa2-4483-a19c-34fb725948e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:03.199025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3935d-9fa2-4483-a19c-34fb725948e1 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:03.206595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:03.224657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:03.225227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:03.225750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] PATH_INFO: `/v3/projects/af610babba3f4d889d310be096401e94` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:03.232370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af610babba3f4d889d310be096401e94)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:03.237132 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:03.374430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af610babba3f4d889d310be096401e94', 'request_id': 'req-2445c23c-0123-4701-8129-6ce688106432'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:03.388094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af610babba3f4d889d310be096401e94', 'request_id': 'req-2445c23c-0123-4701-8129-6ce688106432'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:03.400019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af610babba3f4d889d310be096401e94', 'request_id': 'req-2445c23c-0123-4701-8129-6ce688106432'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:03.422831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] The token cache is being invalidate because project af610babba3f4d889d310be096401e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:24:03.423126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:03.423838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:03.425977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1193/2359] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:24:03 2022] DELETE /identity/v3/projects/af610babba3f4d889d310be096401e94 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:03.430539 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30c76b-a09d-4c4a-b110-61249d5d78ca service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:03.462773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30c76b-a09d-4c4a-b110-61249d5d78ca service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:03.603829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:03.605362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:03.606397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:03.606397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] PATH_INFO: `/v3/users/a399e56244ae4035b2b97c51e87799b8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:03.609072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a399e56244ae4035b2b97c51e87799b8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:03.612584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:03.709962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a399e56244ae4035b2b97c51e87799b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:03.733425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a399e56244ae4035b2b97c51e87799b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:03.747164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a399e56244ae4035b2b97c51e87799b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:03.748067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a399e56244ae4035b2b97c51e87799b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:03.748811 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f4a6d3ff-42df-49bd-92d8-13025a5b1f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a399e56244ae4035b2b97c51e87799b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:03.788796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1167/2360] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:24:03 2022] DELETE /identity/v3/users/a399e56244ae4035b2b97c51e87799b8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:04.198650 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:04.200443 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:04.253397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445c23c-0123-4701-8129-6ce688106432 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:04.303806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:04.356882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:04.357560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:04.357839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:04.358147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] PATH_INFO: `/v3/projects/7a01586fa64e49858cd054e8402157a1` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:04.359381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a01586fa64e49858cd054e8402157a1)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:04.363672 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:04.455780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a01586fa64e49858cd054e8402157a1', 'request_id': 'req-be7ba410-51be-44b4-a364-89ca77bcd83b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:04.471743 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a01586fa64e49858cd054e8402157a1', 'request_id': 'req-be7ba410-51be-44b4-a364-89ca77bcd83b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:04.481576 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a01586fa64e49858cd054e8402157a1', 'request_id': 'req-be7ba410-51be-44b4-a364-89ca77bcd83b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:04.517183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] The token cache is being invalidate because project 7a01586fa64e49858cd054e8402157a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:24:04.517508 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:04.518335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-be7ba410-51be-44b4-a364-89ca77bcd83b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:04.520018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1194/2361] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:24:04 2022] DELETE /identity/v3/projects/7a01586fa64e49858cd054e8402157a1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:04.525935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfe3a6-ec19-4b25-80da-7c9e44fbbaf6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:04.526529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfe3a6-ec19-4b25-80da-7c9e44fbbaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:04.526529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfe3a6-ec19-4b25-80da-7c9e44fbbaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:04.580104 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-50dfe3a6-ec19-4b25-80da-7c9e44fbbaf6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:04.581452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-50dfe3a6-ec19-4b25-80da-7c9e44fbbaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:04.723267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1168/2362] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:04.731787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ac78-8896-4ecf-a669-5e89b1008ccc None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:04.732093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ac78-8896-4ecf-a669-5e89b1008ccc None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:04.732336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ac78-8896-4ecf-a669-5e89b1008ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:04.780987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6508ac78-8896-4ecf-a669-5e89b1008ccc None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:04.782214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6508ac78-8896-4ecf-a669-5e89b1008ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:04.795888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1195/2363] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:04.796782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfe3a6-ec19-4b25-80da-7c9e44fbbaf6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:04.813897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:04.818949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfe3a6-ec19-4b25-80da-7c9e44fbbaf6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:04.827913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37f2f4-ee71-4cbe-b1f1-1a9e48bbbe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:04.828816 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37f2f4-ee71-4cbe-b1f1-1a9e48bbbe4a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:04.829267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37f2f4-ee71-4cbe-b1f1-1a9e48bbbe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:04.829719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37f2f4-ee71-4cbe-b1f1-1a9e48bbbe4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:04.830388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37f2f4-ee71-4cbe-b1f1-1a9e48bbbe4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:24:04.830870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37f2f4-ee71-4cbe-b1f1-1a9e48bbbe4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:04.836968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37f2f4-ee71-4cbe-b1f1-1a9e48bbbe4a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:04.851331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1169/2364] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:24:04.855925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508ac78-8896-4ecf-a669-5e89b1008ccc None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:04.873840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508ac78-8896-4ecf-a669-5e89b1008ccc None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:04.891848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcb4b6-592f-410c-917b-6975a762038c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:04.892491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcb4b6-592f-410c-917b-6975a762038c admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:04.892763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcb4b6-592f-410c-917b-6975a762038c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:04.893042 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcb4b6-592f-410c-917b-6975a762038c admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:04.894257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcb4b6-592f-410c-917b-6975a762038c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:04.895631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcb4b6-592f-410c-917b-6975a762038c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:04.986323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37f2f4-ee71-4cbe-b1f1-1a9e48bbbe4a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:04.997104 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1196/2365] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:24:04 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:24:05.001125 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37f2f4-ee71-4cbe-b1f1-1a9e48bbbe4a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:05.103277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf7ced-8921-4606-94ac-4e2ffa7fb28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:05.103277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf7ced-8921-4606-94ac-4e2ffa7fb28b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:05.103277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf7ced-8921-4606-94ac-4e2ffa7fb28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:05.103277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf7ced-8921-4606-94ac-4e2ffa7fb28b admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:05.103846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf7ced-8921-4606-94ac-4e2ffa7fb28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:05.103846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf7ced-8921-4606-94ac-4e2ffa7fb28b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:05.153859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcb4b6-592f-410c-917b-6975a762038c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:05.155177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1170/2366] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:24:04 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:24:05.171569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcb4b6-592f-410c-917b-6975a762038c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:05.223613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac103f2-c6ff-4ae2-a5e1-6ddf885861b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:05.225791 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac103f2-c6ff-4ae2-a5e1-6ddf885861b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:05.227897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac103f2-c6ff-4ae2-a5e1-6ddf885861b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:05.228180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac103f2-c6ff-4ae2-a5e1-6ddf885861b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:05.231460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac103f2-c6ff-4ae2-a5e1-6ddf885861b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:05.258620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac103f2-c6ff-4ae2-a5e1-6ddf885861b5 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:05.325532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1197/2367] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:24:05.326921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf7ced-8921-4606-94ac-4e2ffa7fb28b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:05.342465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf7ced-8921-4606-94ac-4e2ffa7fb28b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:05.347828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c523dd6-19a6-4959-b119-e3486655d8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:05.348683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523dd6-19a6-4959-b119-e3486655d8ab admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:05.349170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523dd6-19a6-4959-b119-e3486655d8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:05.349779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523dd6-19a6-4959-b119-e3486655d8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:05.350779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c523dd6-19a6-4959-b119-e3486655d8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:05.356535 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c523dd6-19a6-4959-b119-e3486655d8ab admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:05.374003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1171/2368] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:24:05.374915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac103f2-c6ff-4ae2-a5e1-6ddf885861b5 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:05.390581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac103f2-c6ff-4ae2-a5e1-6ddf885861b5 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:05.401565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ca3a2-c8c1-4688-bb25-c05ba9606536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:05.402284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ca3a2-c8c1-4688-bb25-c05ba9606536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:05.402562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ca3a2-c8c1-4688-bb25-c05ba9606536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:05.402835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ca3a2-c8c1-4688-bb25-c05ba9606536 admin admin] PATH_INFO: `/v3/projects/ddbde1d8568d4dbd9562ff9d1b2d0e10/users/2385fbc44aa94487b0dc4f383e99e4c2/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:05.445185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ca3a2-c8c1-4688-bb25-c05ba9606536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddbde1d8568d4dbd9562ff9d1b2d0e10, user_id=2385fbc44aa94487b0dc4f383e99e4c2, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:05.450129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ca3a2-c8c1-4688-bb25-c05ba9606536 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:05.471302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1198/2369] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:24:05 2022] PUT /identity/v3/projects/ddbde1d8568d4dbd9562ff9d1b2d0e10/users/2385fbc44aa94487b0dc4f383e99e4c2/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:05.474237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cccad5-9ee5-42dc-a65b-fb2b47bec58a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:05.474666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cccad5-9ee5-42dc-a65b-fb2b47bec58a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:05.475222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cccad5-9ee5-42dc-a65b-fb2b47bec58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:05.515536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-58cccad5-9ee5-42dc-a65b-fb2b47bec58a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:05.516969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-58cccad5-9ee5-42dc-a65b-fb2b47bec58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:05.608008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1172/2370] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:05.616961 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ca3a2-c8c1-4688-bb25-c05ba9606536 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:05.618969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ae6ca3a2-c8c1-4688-bb25-c05ba9606536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:05.717264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ca3a2-c8c1-4688-bb25-c05ba9606536 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:05.721504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621607f-c1a5-4017-afa5-d5f32021a093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:05.722188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621607f-c1a5-4017-afa5-d5f32021a093 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:05.722471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621607f-c1a5-4017-afa5-d5f32021a093 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:05.722797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621607f-c1a5-4017-afa5-d5f32021a093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:05.737038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621607f-c1a5-4017-afa5-d5f32021a093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:05.739335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621607f-c1a5-4017-afa5-d5f32021a093 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:05.769693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1199/2371] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:24:07.031890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef595-2195-4247-9fb3-0de9cef191fc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:07.032491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef595-2195-4247-9fb3-0de9cef191fc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:07.032491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef595-2195-4247-9fb3-0de9cef191fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:07.103550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-acfef595-2195-4247-9fb3-0de9cef191fc None None] MFA Rules not processed for user `2385fbc44aa94487b0dc4f383e99e4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:07.104354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-acfef595-2195-4247-9fb3-0de9cef191fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:07.294967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:07.302275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1173/2372] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:07.316532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621607f-c1a5-4017-afa5-d5f32021a093 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:07.318079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d621607f-c1a5-4017-afa5-d5f32021a093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:07.326550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:07.453522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621607f-c1a5-4017-afa5-d5f32021a093 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:07.461882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd4f7e-fc17-4d00-8c98-3c037793faa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:07.462827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4f7e-fc17-4d00-8c98-3c037793faa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:07.463499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4f7e-fc17-4d00-8c98-3c037793faa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:07.463971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4f7e-fc17-4d00-8c98-3c037793faa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:07.483887 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4f7e-fc17-4d00-8c98-3c037793faa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:07.485439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4f7e-fc17-4d00-8c98-3c037793faa0 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:07.497846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1200/2373] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:08.027514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef595-2195-4247-9fb3-0de9cef191fc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:08.029808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-acfef595-2195-4247-9fb3-0de9cef191fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:08.047735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef595-2195-4247-9fb3-0de9cef191fc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:08.053689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:08.054395 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:08.054673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:08.055043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] PATH_INFO: `/v3/users/faf38182e69e4c70acebe6193e3e6768` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:08.056225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf38182e69e4c70acebe6193e3e6768)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:08.058204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:08.150147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf38182e69e4c70acebe6193e3e6768'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:08.169862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf38182e69e4c70acebe6193e3e6768'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:08.180418 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf38182e69e4c70acebe6193e3e6768'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:08.181201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf38182e69e4c70acebe6193e3e6768'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:08.181809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf38182e69e4c70acebe6193e3e6768'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:08.200372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1174/2374] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:24:08 2022] DELETE /identity/v3/users/faf38182e69e4c70acebe6193e3e6768 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:08.204868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e17376-4b46-4d87-9c8b-df220d0d4e70 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:08.205153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e17376-4b46-4d87-9c8b-df220d0d4e70 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:08.205424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e17376-4b46-4d87-9c8b-df220d0d4e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:08.228129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f4e17376-4b46-4d87-9c8b-df220d0d4e70 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:08.229525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f4e17376-4b46-4d87-9c8b-df220d0d4e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:08.310821 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1201/2375] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:08.321561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:08.323166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:08.399108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9a5d-fc7f-4b3b-89ab-72e0f42dbf38 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:08.404891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb364c-5fde-4956-8811-b7b33a8894c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:08.405796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb364c-5fde-4956-8811-b7b33a8894c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:08.406330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb364c-5fde-4956-8811-b7b33a8894c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:08.406767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb364c-5fde-4956-8811-b7b33a8894c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:08.417529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb364c-5fde-4956-8811-b7b33a8894c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:08.419270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb364c-5fde-4956-8811-b7b33a8894c4 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:08.430518 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1175/2376] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:24:08.840489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e17376-4b46-4d87-9c8b-df220d0d4e70 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:08.842948 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f4e17376-4b46-4d87-9c8b-df220d0d4e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:08.860110 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e17376-4b46-4d87-9c8b-df220d0d4e70 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:08.877716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:08.878454 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:08.878797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:08.879128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] PATH_INFO: `/v3/projects/9d17dddcc60f43928d628499135cba79` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:08.881594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d17dddcc60f43928d628499135cba79)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:08.884672 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:08.997904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d17dddcc60f43928d628499135cba79', 'request_id': 'req-34a2b0d3-4753-4268-976b-2eccce6d1174'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:09.009149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d17dddcc60f43928d628499135cba79', 'request_id': 'req-34a2b0d3-4753-4268-976b-2eccce6d1174'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:09.017704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d17dddcc60f43928d628499135cba79', 'request_id': 'req-34a2b0d3-4753-4268-976b-2eccce6d1174'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:09.031988 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] The token cache is being invalidate because project 9d17dddcc60f43928d628499135cba79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:24:09.032238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:09.033025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-34a2b0d3-4753-4268-976b-2eccce6d1174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:09.035285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1202/2377] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:24:08 2022] DELETE /identity/v3/projects/9d17dddcc60f43928d628499135cba79 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:09.040024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b7fc7-6f32-4856-9881-7cfac34ded52 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:09.040747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b7fc7-6f32-4856-9881-7cfac34ded52 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:09.041639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b7fc7-6f32-4856-9881-7cfac34ded52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:09.079193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a86b7fc7-6f32-4856-9881-7cfac34ded52 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:09.080586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a86b7fc7-6f32-4856-9881-7cfac34ded52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:09.128237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e667b-363f-4a0d-83d4-26050702f4b7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:09.128898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e667b-363f-4a0d-83d4-26050702f4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:09.129725 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e667b-363f-4a0d-83d4-26050702f4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:09.247891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1176/2378] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:24:09.255776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72962a2-b8a8-42ff-91ad-67f36934c915 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:09.256119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72962a2-b8a8-42ff-91ad-67f36934c915 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:09.256339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72962a2-b8a8-42ff-91ad-67f36934c915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:09.290713 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e72962a2-b8a8-42ff-91ad-67f36934c915 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:09.291991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e72962a2-b8a8-42ff-91ad-67f36934c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:09.302528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1177/2379] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:24:09.308411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72962a2-b8a8-42ff-91ad-67f36934c915 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:09.321783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72962a2-b8a8-42ff-91ad-67f36934c915 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:09.328907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609584ce-0e89-4f06-b6db-7e108e15e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:09.330214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609584ce-0e89-4f06-b6db-7e108e15e518 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:09.330669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609584ce-0e89-4f06-b6db-7e108e15e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:09.332174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609584ce-0e89-4f06-b6db-7e108e15e518 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:09.333052 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609584ce-0e89-4f06-b6db-7e108e15e518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:24:09.333944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609584ce-0e89-4f06-b6db-7e108e15e518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:09.336109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609584ce-0e89-4f06-b6db-7e108e15e518 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:09.341446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:09.347894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0e5e667b-363f-4a0d-83d4-26050702f4b7 None None] MFA Rules not processed for user `2385fbc44aa94487b0dc4f383e99e4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:09.349686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0e5e667b-363f-4a0d-83d4-26050702f4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:09.360836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1178/2380] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:24:09.364716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609584ce-0e89-4f06-b6db-7e108e15e518 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:09.377237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609584ce-0e89-4f06-b6db-7e108e15e518 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:09.382620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:09.382957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278753a-06df-4a0a-81eb-263d4fc14f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:09.383885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278753a-06df-4a0a-81eb-263d4fc14f12 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:09.384264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278753a-06df-4a0a-81eb-263d4fc14f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:09.384624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278753a-06df-4a0a-81eb-263d4fc14f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:09.385383 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278753a-06df-4a0a-81eb-263d4fc14f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:09.387939 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278753a-06df-4a0a-81eb-263d4fc14f12 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:09.425097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1179/2381] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:24:09 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:24:09.429974 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278753a-06df-4a0a-81eb-263d4fc14f12 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:09.444527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1203/2382] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:09.511476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278753a-06df-4a0a-81eb-263d4fc14f12 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:09.516474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270289-6b8f-4cf4-b077-3cb46f573489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:09.517200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270289-6b8f-4cf4-b077-3cb46f573489 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:09.517500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270289-6b8f-4cf4-b077-3cb46f573489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:09.517776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270289-6b8f-4cf4-b077-3cb46f573489 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:09.518417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb270289-6b8f-4cf4-b077-3cb46f573489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:09.520414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb270289-6b8f-4cf4-b077-3cb46f573489 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:09.563438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1180/2383] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:24:09 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:24:09.565013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e667b-363f-4a0d-83d4-26050702f4b7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:09.588357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e667b-363f-4a0d-83d4-26050702f4b7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:09.598284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a55d0-4a55-45c0-b18d-3e207925970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:09.600348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a55d0-4a55-45c0-b18d-3e207925970b admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:09.600348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a55d0-4a55-45c0-b18d-3e207925970b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:09.600613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a55d0-4a55-45c0-b18d-3e207925970b admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:09.603760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a55d0-4a55-45c0-b18d-3e207925970b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:09.605619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a55d0-4a55-45c0-b18d-3e207925970b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:09.621621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1204/2384] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:24:09.625760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270289-6b8f-4cf4-b077-3cb46f573489 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:09.636985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270289-6b8f-4cf4-b077-3cb46f573489 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:09.644773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0018e7-22fd-4e2c-93d1-b65517413464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:09.645334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0018e7-22fd-4e2c-93d1-b65517413464 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:09.645623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0018e7-22fd-4e2c-93d1-b65517413464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:09.645969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0018e7-22fd-4e2c-93d1-b65517413464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:09.646792 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0018e7-22fd-4e2c-93d1-b65517413464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:09.648551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0018e7-22fd-4e2c-93d1-b65517413464 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:09.666802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a55d0-4a55-45c0-b18d-3e207925970b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:09.668165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1181/2385] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:24:09.678772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a55d0-4a55-45c0-b18d-3e207925970b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:09.685117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd943d-6a5c-4398-9425-c551af914571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:09.685921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd943d-6a5c-4398-9425-c551af914571 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:09.686419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd943d-6a5c-4398-9425-c551af914571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:09.686789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd943d-6a5c-4398-9425-c551af914571 admin admin] PATH_INFO: `/v3/projects/2838f6f8a6ee4d4496ca4562882da15c/users/098eeea40e8f43ba8e0157bea9825b1a/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:09.729093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd943d-6a5c-4398-9425-c551af914571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2838f6f8a6ee4d4496ca4562882da15c, user_id=098eeea40e8f43ba8e0157bea9825b1a, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:09.733845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd943d-6a5c-4398-9425-c551af914571 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:09.764725 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1205/2386] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:24:09 2022] PUT /identity/v3/projects/2838f6f8a6ee4d4496ca4562882da15c/users/098eeea40e8f43ba8e0157bea9825b1a/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:09.777281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306ff4-4b7f-44ab-8641-9a63d76c663d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:09.777572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306ff4-4b7f-44ab-8641-9a63d76c663d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:09.777854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306ff4-4b7f-44ab-8641-9a63d76c663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:09.815194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5d306ff4-4b7f-44ab-8641-9a63d76c663d None None] MFA Rules not processed for user `098eeea40e8f43ba8e0157bea9825b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:09.817878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5d306ff4-4b7f-44ab-8641-9a63d76c663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:09.919510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1182/2387] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:09.930767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd943d-6a5c-4398-9425-c551af914571 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:09.933251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-48cd943d-6a5c-4398-9425-c551af914571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:10.028671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd943d-6a5c-4398-9425-c551af914571 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:10.038981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8762ad-7b10-46a7-bbdf-57fb53018ab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:10.039697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8762ad-7b10-46a7-bbdf-57fb53018ab6 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:10.039979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8762ad-7b10-46a7-bbdf-57fb53018ab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:10.040259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8762ad-7b10-46a7-bbdf-57fb53018ab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:10.069538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8762ad-7b10-46a7-bbdf-57fb53018ab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:10.071336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8762ad-7b10-46a7-bbdf-57fb53018ab6 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:10.097310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1206/2388] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:11.646448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc124a-ac90-4f2e-a413-79915ec397bc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:11.647446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc124a-ac90-4f2e-a413-79915ec397bc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:11.647734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc124a-ac90-4f2e-a413-79915ec397bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:11.677815 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cbdc124a-ac90-4f2e-a413-79915ec397bc None None] MFA Rules not processed for user `098eeea40e8f43ba8e0157bea9825b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:11.686908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cbdc124a-ac90-4f2e-a413-79915ec397bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:11.708254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1183/2389] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:16.190843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e0325-9a8c-4d3e-b787-dfdfddc182f7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:16.195716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e0325-9a8c-4d3e-b787-dfdfddc182f7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:16.196294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e0325-9a8c-4d3e-b787-dfdfddc182f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:16.221162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-9b0e0325-9a8c-4d3e-b787-dfdfddc182f7 None None] MFA Rules not processed for user `4b2683d66665426e8a60614971b04bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:16.222396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9b0e0325-9a8c-4d3e-b787-dfdfddc182f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:16.278379 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1207/2390] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:20.692323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da3c95-0f0b-44ce-b4a1-bec11ad83803 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:20.693423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da3c95-0f0b-44ce-b4a1-bec11ad83803 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:20.693880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da3c95-0f0b-44ce-b4a1-bec11ad83803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:20.729338 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-58da3c95-0f0b-44ce-b4a1-bec11ad83803 None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:20.732631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-58da3c95-0f0b-44ce-b4a1-bec11ad83803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:20.773646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:20.806199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1184/2391] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:20.825996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e0325-9a8c-4d3e-b787-dfdfddc182f7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:20.827626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9b0e0325-9a8c-4d3e-b787-dfdfddc182f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:20.921130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:20.967920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e0325-9a8c-4d3e-b787-dfdfddc182f7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:20.974155 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f071-cfdb-4fc3-8f64-c77b143b0cd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:20.975151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f071-cfdb-4fc3-8f64-c77b143b0cd4 service swift] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:20.976012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f071-cfdb-4fc3-8f64-c77b143b0cd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:20.978096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f071-cfdb-4fc3-8f64-c77b143b0cd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:20.991566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f071-cfdb-4fc3-8f64-c77b143b0cd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:20.994310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f071-cfdb-4fc3-8f64-c77b143b0cd4 service swift] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:21.006055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1208/2392] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:24:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:24:21.644705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da3c95-0f0b-44ce-b4a1-bec11ad83803 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:21.652475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-58da3c95-0f0b-44ce-b4a1-bec11ad83803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:21.770311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da3c95-0f0b-44ce-b4a1-bec11ad83803 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:21.776163 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:21.777116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:21.777591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:21.779054 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] PATH_INFO: `/v3/users/721a847d76a840fcb9681ddee0a374f1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:21.780750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=721a847d76a840fcb9681ddee0a374f1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:21.782968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:21.883798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721a847d76a840fcb9681ddee0a374f1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:21.897398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721a847d76a840fcb9681ddee0a374f1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:21.905267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721a847d76a840fcb9681ddee0a374f1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:21.906066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721a847d76a840fcb9681ddee0a374f1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:21.906827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721a847d76a840fcb9681ddee0a374f1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:21.933487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1185/2393] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:24:21 2022] DELETE /identity/v3/users/721a847d76a840fcb9681ddee0a374f1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:21.934841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ae5d3-7596-484c-a244-1a9b5dcccd25 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:21.935311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ae5d3-7596-484c-a244-1a9b5dcccd25 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:21.935405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ae5d3-7596-484c-a244-1a9b5dcccd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:21.963662 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ab2ae5d3-7596-484c-a244-1a9b5dcccd25 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:21.965022 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ab2ae5d3-7596-484c-a244-1a9b5dcccd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:22.044456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1209/2394] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:24:22.056262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:22.057887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:22.125009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee8c06-a83a-4b2a-85d1-b2512f03e61c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:22.128989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95400bc5-7fb4-4189-b52c-4136edf4e49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:22.129610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95400bc5-7fb4-4189-b52c-4136edf4e49a service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:22.130024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95400bc5-7fb4-4189-b52c-4136edf4e49a service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:22.130304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95400bc5-7fb4-4189-b52c-4136edf4e49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:22.169301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95400bc5-7fb4-4189-b52c-4136edf4e49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:22.170837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95400bc5-7fb4-4189-b52c-4136edf4e49a service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:22.190194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1186/2395] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:22.941769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ae5d3-7596-484c-a244-1a9b5dcccd25 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:22.943937 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ab2ae5d3-7596-484c-a244-1a9b5dcccd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:22.969368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ae5d3-7596-484c-a244-1a9b5dcccd25 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:22.981611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:22.982976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:22.984435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:22.984952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] PATH_INFO: `/v3/projects/ff93fc6af50a4160bbcf5cd7bcbc0553` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:22.986992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff93fc6af50a4160bbcf5cd7bcbc0553)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:22.992586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:23.128192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff93fc6af50a4160bbcf5cd7bcbc0553', 'request_id': 'req-99d34e06-5e19-486e-9698-52ebdd2855d5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:23.142068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff93fc6af50a4160bbcf5cd7bcbc0553', 'request_id': 'req-99d34e06-5e19-486e-9698-52ebdd2855d5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:23.150746 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff93fc6af50a4160bbcf5cd7bcbc0553', 'request_id': 'req-99d34e06-5e19-486e-9698-52ebdd2855d5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:23.182040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] The token cache is being invalidate because project ff93fc6af50a4160bbcf5cd7bcbc0553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:24:23.182344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:23.183127 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-99d34e06-5e19-486e-9698-52ebdd2855d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:23.188201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1210/2396] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:24:22 2022] DELETE /identity/v3/projects/ff93fc6af50a4160bbcf5cd7bcbc0553 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:23.197963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d4bc-2529-43ce-9283-6904bc711f87 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:23.199392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d4bc-2529-43ce-9283-6904bc711f87 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:23.200035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d4bc-2529-43ce-9283-6904bc711f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:23.211720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:23.245310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d008d4bc-2529-43ce-9283-6904bc711f87 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:23.246572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d008d4bc-2529-43ce-9283-6904bc711f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:23.337022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1187/2397] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:23.344991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a88e7-4924-4575-87fe-f55d22790c94 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:23.345280 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a88e7-4924-4575-87fe-f55d22790c94 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:23.345565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a88e7-4924-4575-87fe-f55d22790c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:23.370575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-9f7a88e7-4924-4575-87fe-f55d22790c94 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:23.373123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9f7a88e7-4924-4575-87fe-f55d22790c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:23.381581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1211/2398] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:23.385878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008d4bc-2529-43ce-9283-6904bc711f87 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:23.397369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008d4bc-2529-43ce-9283-6904bc711f87 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:23.431316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce482d-6a54-48c2-8321-3bcf47eb12b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:23.431911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce482d-6a54-48c2-8321-3bcf47eb12b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:23.432195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce482d-6a54-48c2-8321-3bcf47eb12b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:23.432470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce482d-6a54-48c2-8321-3bcf47eb12b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:23.433148 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce482d-6a54-48c2-8321-3bcf47eb12b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:24:23.433451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce482d-6a54-48c2-8321-3bcf47eb12b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:23.435093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce482d-6a54-48c2-8321-3bcf47eb12b5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:23.461796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1188/2399] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:24:23.463441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a88e7-4924-4575-87fe-f55d22790c94 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:23.473771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a88e7-4924-4575-87fe-f55d22790c94 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:23.488807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5caed-b9b8-4f56-b7ba-516ef12cb5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:23.489456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5caed-b9b8-4f56-b7ba-516ef12cb5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:23.489736 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5caed-b9b8-4f56-b7ba-516ef12cb5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:23.490014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5caed-b9b8-4f56-b7ba-516ef12cb5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:23.490648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5caed-b9b8-4f56-b7ba-516ef12cb5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:23.496247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5caed-b9b8-4f56-b7ba-516ef12cb5a8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:23.583196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce482d-6a54-48c2-8321-3bcf47eb12b5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:23.583798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1212/2400] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:24:23 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:24:23.596044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce482d-6a54-48c2-8321-3bcf47eb12b5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:23.673197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44c6b-989e-48e7-9ced-37b9173eb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:23.673930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44c6b-989e-48e7-9ced-37b9173eb9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:23.674233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44c6b-989e-48e7-9ced-37b9173eb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:23.674523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44c6b-989e-48e7-9ced-37b9173eb9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:23.675351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44c6b-989e-48e7-9ced-37b9173eb9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:23.677555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44c6b-989e-48e7-9ced-37b9173eb9b6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:23.702937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1189/2401] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:24:23 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:24:23.706996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5caed-b9b8-4f56-b7ba-516ef12cb5a8 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:23.717742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5caed-b9b8-4f56-b7ba-516ef12cb5a8 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:23.722616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d818d-3138-45ed-a12b-f1c842a9e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:23.723267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d818d-3138-45ed-a12b-f1c842a9e70b admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:23.723602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d818d-3138-45ed-a12b-f1c842a9e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:23.723845 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d818d-3138-45ed-a12b-f1c842a9e70b admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:23.724485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d818d-3138-45ed-a12b-f1c842a9e70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:23.726483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d818d-3138-45ed-a12b-f1c842a9e70b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:23.737566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1213/2402] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:24:23.741833 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44c6b-989e-48e7-9ced-37b9173eb9b6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:23.752870 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44c6b-989e-48e7-9ced-37b9173eb9b6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:23.757937 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128e9f7-beb3-45a8-892c-44a57a926383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:23.758590 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e9f7-beb3-45a8-892c-44a57a926383 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:23.758889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e9f7-beb3-45a8-892c-44a57a926383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:23.759159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128e9f7-beb3-45a8-892c-44a57a926383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:23.759935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128e9f7-beb3-45a8-892c-44a57a926383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:23.761573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128e9f7-beb3-45a8-892c-44a57a926383 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:23.772769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1190/2403] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:24:23.777463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d818d-3138-45ed-a12b-f1c842a9e70b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:23.788313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d818d-3138-45ed-a12b-f1c842a9e70b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:23.793853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196548a2-aec2-4f5b-8076-638e7ad3ec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:23.794556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196548a2-aec2-4f5b-8076-638e7ad3ec53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:23.794833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196548a2-aec2-4f5b-8076-638e7ad3ec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:23.795105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196548a2-aec2-4f5b-8076-638e7ad3ec53 admin admin] PATH_INFO: `/v3/projects/c4fc0657db8f425f828cd50af31cd578/users/cb0fe6fdc48e411787f7754a15895cd6/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:23.811839 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196548a2-aec2-4f5b-8076-638e7ad3ec53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fc0657db8f425f828cd50af31cd578, user_id=cb0fe6fdc48e411787f7754a15895cd6, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:23.814553 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196548a2-aec2-4f5b-8076-638e7ad3ec53 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:23.817866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:23.841192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1214/2404] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:24:23 2022] PUT /identity/v3/projects/c4fc0657db8f425f828cd50af31cd578/users/cb0fe6fdc48e411787f7754a15895cd6/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:24:23.843615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38acdd-d3d6-4167-982e-fd293f98dd62 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:23.844099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38acdd-d3d6-4167-982e-fd293f98dd62 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:23.844550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38acdd-d3d6-4167-982e-fd293f98dd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:23.897372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-eb38acdd-d3d6-4167-982e-fd293f98dd62 None None] MFA Rules not processed for user `cb0fe6fdc48e411787f7754a15895cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:23.899798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eb38acdd-d3d6-4167-982e-fd293f98dd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:24.004989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:24.009646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1191/2405] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:24:24.022450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196548a2-aec2-4f5b-8076-638e7ad3ec53 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:24.024636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-196548a2-aec2-4f5b-8076-638e7ad3ec53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:24.114098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196548a2-aec2-4f5b-8076-638e7ad3ec53 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:24.128894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5294604-c908-4dd1-865f-691fe5f1524e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:24.129956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5294604-c908-4dd1-865f-691fe5f1524e service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:24.130514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5294604-c908-4dd1-865f-691fe5f1524e service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:24.130935 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5294604-c908-4dd1-865f-691fe5f1524e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:24.141178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5294604-c908-4dd1-865f-691fe5f1524e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:24.143110 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5294604-c908-4dd1-865f-691fe5f1524e service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:24.154889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1215/2406] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:30.353446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96fee3-3452-48db-bd98-b5078d674ae8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:30.354060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96fee3-3452-48db-bd98-b5078d674ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:30.354060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96fee3-3452-48db-bd98-b5078d674ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:30.376138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3a96fee3-3452-48db-bd98-b5078d674ae8 None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:30.377903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3a96fee3-3452-48db-bd98-b5078d674ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:30.444524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1192/2407] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:30.457764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5294604-c908-4dd1-865f-691fe5f1524e service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:30.459160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d5294604-c908-4dd1-865f-691fe5f1524e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:30.565546 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5294604-c908-4dd1-865f-691fe5f1524e service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:30.572854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61c65-03ab-4d40-ad99-fc1a71ab92b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:30.574077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61c65-03ab-4d40-ad99-fc1a71ab92b0 service swift] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:30.574501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61c65-03ab-4d40-ad99-fc1a71ab92b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:30.575572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61c65-03ab-4d40-ad99-fc1a71ab92b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:30.587930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61c65-03ab-4d40-ad99-fc1a71ab92b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:30.590145 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61c65-03ab-4d40-ad99-fc1a71ab92b0 service swift] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:30.601915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1216/2408] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:24:40.434053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=26 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:40.596914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=60 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:42.895088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e1eb3-560c-4442-9ee9-aab226f3b34d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:42.895662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e1eb3-560c-4442-9ee9-aab226f3b34d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:42.895765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e1eb3-560c-4442-9ee9-aab226f3b34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:42.915405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f21e1eb3-560c-4442-9ee9-aab226f3b34d None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:42.916653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f21e1eb3-560c-4442-9ee9-aab226f3b34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:42.924006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1193/2409] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:42.949907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61c65-03ab-4d40-ad99-fc1a71ab92b0 service swift] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:42.964664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61c65-03ab-4d40-ad99-fc1a71ab92b0 service swift] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:42.987761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098be48-ef09-4de5-ad9c-d1a32bdf6959 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:42.989147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098be48-ef09-4de5-ad9c-d1a32bdf6959 service swift] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:42.989620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098be48-ef09-4de5-ad9c-d1a32bdf6959 service swift] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:42.990061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098be48-ef09-4de5-ad9c-d1a32bdf6959 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:43.000739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098be48-ef09-4de5-ad9c-d1a32bdf6959 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:43.002550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098be48-ef09-4de5-ad9c-d1a32bdf6959 service swift] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:43.012989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1217/2410] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:24:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:24:43.612568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476edc3-5c8f-428d-a233-78d3648ae955 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:43.612879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476edc3-5c8f-428d-a233-78d3648ae955 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:43.613332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476edc3-5c8f-428d-a233-78d3648ae955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:43.634612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1476edc3-5c8f-428d-a233-78d3648ae955 None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:43.635912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1476edc3-5c8f-428d-a233-78d3648ae955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:43.643195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1194/2411] 10.222.0.39 () {58 vars in 967 bytes} [Sat Sep 3 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:43.656435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098be48-ef09-4de5-ad9c-d1a32bdf6959 service swift] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:43.668801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098be48-ef09-4de5-ad9c-d1a32bdf6959 service swift] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:43.674190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927f94-3dec-404d-be78-775dd8d3e37f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:43.675082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927f94-3dec-404d-be78-775dd8d3e37f service swift] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:43.675500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927f94-3dec-404d-be78-775dd8d3e37f service swift] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:43.675871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927f94-3dec-404d-be78-775dd8d3e37f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:43.684985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927f94-3dec-404d-be78-775dd8d3e37f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:43.686787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927f94-3dec-404d-be78-775dd8d3e37f service swift] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:43.706177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1218/2412] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:24:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:24:43.709195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf776d-e75f-4cf6-b300-464daab2d18e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:43.709532 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf776d-e75f-4cf6-b300-464daab2d18e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:43.709835 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf776d-e75f-4cf6-b300-464daab2d18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:43.732915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f5bf776d-e75f-4cf6-b300-464daab2d18e None None] MFA Rules not processed for user `2385fbc44aa94487b0dc4f383e99e4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:43.734259 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f5bf776d-e75f-4cf6-b300-464daab2d18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:43.813439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1195/2413] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:24:44.007192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcbf6a-be4f-48e9-9628-313b1ec65849 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:44.007751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcbf6a-be4f-48e9-9628-313b1ec65849 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:44.007751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcbf6a-be4f-48e9-9628-313b1ec65849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:44.027636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ddbcbf6a-be4f-48e9-9628-313b1ec65849 None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:44.029143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ddbcbf6a-be4f-48e9-9628-313b1ec65849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:44.037095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1219/2414] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:44.049934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf776d-e75f-4cf6-b300-464daab2d18e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:44.064245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf776d-e75f-4cf6-b300-464daab2d18e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:44.069467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea6b47-0700-4b8d-a322-c37a617a80d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:44.070095 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6b47-0700-4b8d-a322-c37a617a80d8 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:44.070374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6b47-0700-4b8d-a322-c37a617a80d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:44.070630 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6b47-0700-4b8d-a322-c37a617a80d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:44.079309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea6b47-0700-4b8d-a322-c37a617a80d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:44.080897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea6b47-0700-4b8d-a322-c37a617a80d8 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:44.098180 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1196/2415] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:24:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:24:44.458596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b070f95-5813-4546-bda7-1161429a6dbf None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:44.459136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b070f95-5813-4546-bda7-1161429a6dbf None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:44.459661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b070f95-5813-4546-bda7-1161429a6dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:44.484507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-0b070f95-5813-4546-bda7-1161429a6dbf None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:44.486062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0b070f95-5813-4546-bda7-1161429a6dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:44.497535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1220/2416] 10.222.0.39 () {58 vars in 967 bytes} [Sat Sep 3 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:44.514529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea6b47-0700-4b8d-a322-c37a617a80d8 service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:44.526203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea6b47-0700-4b8d-a322-c37a617a80d8 service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:44.532806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8bc73-0688-45b3-a13b-04e4e805bf76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:44.533667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8bc73-0688-45b3-a13b-04e4e805bf76 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:44.534137 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8bc73-0688-45b3-a13b-04e4e805bf76 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:44.534636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8bc73-0688-45b3-a13b-04e4e805bf76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:44.547223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8bc73-0688-45b3-a13b-04e4e805bf76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:44.548860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8bc73-0688-45b3-a13b-04e4e805bf76 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:44.574013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1197/2417] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:24:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:24:46.925552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b070f95-5813-4546-bda7-1161429a6dbf None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:46.927032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0b070f95-5813-4546-bda7-1161429a6dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:47.000684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b070f95-5813-4546-bda7-1161429a6dbf None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:47.005825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:47.007051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.007341 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.007907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] PATH_INFO: `/v3/users/098eeea40e8f43ba8e0157bea9825b1a` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.009115 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=098eeea40e8f43ba8e0157bea9825b1a)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:47.011060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:47.069063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098eeea40e8f43ba8e0157bea9825b1a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:47.082588 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098eeea40e8f43ba8e0157bea9825b1a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:47.090093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098eeea40e8f43ba8e0157bea9825b1a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:47.090825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098eeea40e8f43ba8e0157bea9825b1a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:47.091467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a5fda604-4c48-47c7-9bb0-a8abd6172d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098eeea40e8f43ba8e0157bea9825b1a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:47.109558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1221/2418] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:24:46 2022] DELETE /identity/v3/users/098eeea40e8f43ba8e0157bea9825b1a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:47.113951 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a06d-9f48-40fb-97ec-b2eeeae0a40a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.114402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a06d-9f48-40fb-97ec-b2eeeae0a40a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.114891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a06d-9f48-40fb-97ec-b2eeeae0a40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.155889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2501a06d-9f48-40fb-97ec-b2eeeae0a40a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:47.157464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2501a06d-9f48-40fb-97ec-b2eeeae0a40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:47.237051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e268dd6-06fd-4145-ab47-b717e76a9772 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.237667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e268dd6-06fd-4145-ab47-b717e76a9772 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.238290 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e268dd6-06fd-4145-ab47-b717e76a9772 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.240454 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1222/2419] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:24:47.250260 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62529-7b75-4b08-baf9-7daee6165a95 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.250795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62529-7b75-4b08-baf9-7daee6165a95 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.251397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62529-7b75-4b08-baf9-7daee6165a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.273644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-9ca62529-7b75-4b08-baf9-7daee6165a95 None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:47.275758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9ca62529-7b75-4b08-baf9-7daee6165a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:47.293596 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1198/2420] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:47.306199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a06d-9f48-40fb-97ec-b2eeeae0a40a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:47.309831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2501a06d-9f48-40fb-97ec-b2eeeae0a40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:47.335099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:47.385549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1223/2421] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:24:47.398014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a06d-9f48-40fb-97ec-b2eeeae0a40a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:47.400487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca62529-7b75-4b08-baf9-7daee6165a95 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:47.401940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24082a72-e47d-4d46-aaee-3f600bf47748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:47.402072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9ca62529-7b75-4b08-baf9-7daee6165a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:47.402561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24082a72-e47d-4d46-aaee-3f600bf47748 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.402834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24082a72-e47d-4d46-aaee-3f600bf47748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.403100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24082a72-e47d-4d46-aaee-3f600bf47748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.412919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24082a72-e47d-4d46-aaee-3f600bf47748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:47.415103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24082a72-e47d-4d46-aaee-3f600bf47748 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:47.436909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1199/2422] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:47.470264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca62529-7b75-4b08-baf9-7daee6165a95 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:47.475478 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b78ea-5be7-42f4-abea-bf03dc5a09c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54131719962e4463b0b874916cb40973', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:47.476692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b78ea-5be7-42f4-abea-bf03dc5a09c9 service glance] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.479669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b78ea-5be7-42f4-abea-bf03dc5a09c9 service glance] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.480106 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b78ea-5be7-42f4-abea-bf03dc5a09c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.491642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b78ea-5be7-42f4-abea-bf03dc5a09c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:47.493190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b78ea-5be7-42f4-abea-bf03dc5a09c9 service glance] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:47.506607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1224/2423] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:47.589669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c9daa-21e1-4760-a281-6a5e17c4018c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.589977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c9daa-21e1-4760-a281-6a5e17c4018c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.590279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c9daa-21e1-4760-a281-6a5e17c4018c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.591724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1200/2424] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:24:47.596706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831599f-6e21-49ad-9172-abec769b261b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.596963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831599f-6e21-49ad-9172-abec769b261b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.597266 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831599f-6e21-49ad-9172-abec769b261b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.619193 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2831599f-6e21-49ad-9172-abec769b261b None None] MFA Rules not processed for user `8bec5c8c626c40ef9906783916c49dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:47.620350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2831599f-6e21-49ad-9172-abec769b261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:47.627913 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1225/2425] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:24:47.638288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c9daa-21e1-4760-a281-6a5e17c4018c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:47.644302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-396c9daa-21e1-4760-a281-6a5e17c4018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:47.648861 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831599f-6e21-49ad-9172-abec769b261b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:47.663089 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c9daa-21e1-4760-a281-6a5e17c4018c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:47.663424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831599f-6e21-49ad-9172-abec769b261b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:47.669108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:47.670185 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.670463 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.671184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] PATH_INFO: `/v3/projects/2838f6f8a6ee4d4496ca4562882da15c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.671680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639810f-faef-4cd8-857c-13f3ebe52482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:47.672431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639810f-faef-4cd8-857c-13f3ebe52482 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.672656 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639810f-faef-4cd8-857c-13f3ebe52482 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.672847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2838f6f8a6ee4d4496ca4562882da15c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:47.672987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639810f-faef-4cd8-857c-13f3ebe52482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.674650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:47.677398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:47.689714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639810f-faef-4cd8-857c-13f3ebe52482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:47.691299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639810f-faef-4cd8-857c-13f3ebe52482 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:47.700592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1226/2426] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:47.737455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2838f6f8a6ee4d4496ca4562882da15c', 'request_id': 'req-59f88a74-fd12-4a55-ae01-a411408ccce4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:47.751999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2838f6f8a6ee4d4496ca4562882da15c', 'request_id': 'req-59f88a74-fd12-4a55-ae01-a411408ccce4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:47.759852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2838f6f8a6ee4d4496ca4562882da15c', 'request_id': 'req-59f88a74-fd12-4a55-ae01-a411408ccce4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:47.770714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] The token cache is being invalidate because project 2838f6f8a6ee4d4496ca4562882da15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:24:47.771006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:47.771727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59f88a74-fd12-4a55-ae01-a411408ccce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:47.773528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1201/2427] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:24:47 2022] DELETE /identity/v3/projects/2838f6f8a6ee4d4496ca4562882da15c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:47.778221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07791-9ead-4bad-a86c-f54aa31f6110 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.778570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07791-9ead-4bad-a86c-f54aa31f6110 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.778909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07791-9ead-4bad-a86c-f54aa31f6110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.799388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-c9e07791-9ead-4bad-a86c-f54aa31f6110 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:47.800844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c9e07791-9ead-4bad-a86c-f54aa31f6110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:47.831157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c577b-f177-4d02-b344-67b14632bad1 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.831646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c577b-f177-4d02-b344-67b14632bad1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.831997 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c577b-f177-4d02-b344-67b14632bad1 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.837476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1202/2428] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:24:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:24:47.843844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d350594-c8e9-4d1a-bebb-fc6afad824ec None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.844199 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d350594-c8e9-4d1a-bebb-fc6afad824ec None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.844542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d350594-c8e9-4d1a-bebb-fc6afad824ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.866653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5d350594-c8e9-4d1a-bebb-fc6afad824ec None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:47.868155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5d350594-c8e9-4d1a-bebb-fc6afad824ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:47.904163 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1227/2429] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:47.912171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee75284-e1bb-4cde-a7af-c4743b5727c1 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.912616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee75284-e1bb-4cde-a7af-c4743b5727c1 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.913427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee75284-e1bb-4cde-a7af-c4743b5727c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.953564 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-aee75284-e1bb-4cde-a7af-c4743b5727c1 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:47.954996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-aee75284-e1bb-4cde-a7af-c4743b5727c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:47.965351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1228/2430] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:47.969640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee75284-e1bb-4cde-a7af-c4743b5727c1 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:47.980772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee75284-e1bb-4cde-a7af-c4743b5727c1 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:47.987865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcaf9a-114a-4336-ad7f-319da94da838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:47.988692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcaf9a-114a-4336-ad7f-319da94da838 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:47.989031 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcaf9a-114a-4336-ad7f-319da94da838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:47.989372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcaf9a-114a-4336-ad7f-319da94da838 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:47.990147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcaf9a-114a-4336-ad7f-319da94da838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:24:47.990611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcaf9a-114a-4336-ad7f-319da94da838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:47.992423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcaf9a-114a-4336-ad7f-319da94da838 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:47.997938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1203/2431] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:48.009007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1229/2432] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:24:48.012654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d350594-c8e9-4d1a-bebb-fc6afad824ec None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:48.012805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcaf9a-114a-4336-ad7f-319da94da838 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:48.015219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-31bcaf9a-114a-4336-ad7f-319da94da838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:48.029754 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d350594-c8e9-4d1a-bebb-fc6afad824ec None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:48.035409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507913e7-474c-4fc1-a89d-5b6d7327fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:48.036175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507913e7-474c-4fc1-a89d-5b6d7327fc2b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:48.036462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507913e7-474c-4fc1-a89d-5b6d7327fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:48.036736 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507913e7-474c-4fc1-a89d-5b6d7327fc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:48.037672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507913e7-474c-4fc1-a89d-5b6d7327fc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:48.039392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507913e7-474c-4fc1-a89d-5b6d7327fc2b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:48.078655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1204/2433] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:24:48 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:24:48.083668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507913e7-474c-4fc1-a89d-5b6d7327fc2b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:48.111399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:48.148362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcaf9a-114a-4336-ad7f-319da94da838 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:48.171666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507913e7-474c-4fc1-a89d-5b6d7327fc2b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:48.182035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f9486-583c-467c-b166-ea071c6a7f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:48.182035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9486-583c-467c-b166-ea071c6a7f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:48.182035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9486-583c-467c-b166-ea071c6a7f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:48.182035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9486-583c-467c-b166-ea071c6a7f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:48.182426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f9486-583c-467c-b166-ea071c6a7f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:48.182426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f9486-583c-467c-b166-ea071c6a7f38 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:48.194898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:48.223165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1205/2434] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:24:48 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:24:48.224277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f9486-583c-467c-b166-ea071c6a7f38 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:48.234362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d4a05-d559-4df9-b6f2-81a42876a866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:48.235174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d4a05-d559-4df9-b6f2-81a42876a866 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:48.235621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d4a05-d559-4df9-b6f2-81a42876a866 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:48.235892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d4a05-d559-4df9-b6f2-81a42876a866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:48.238216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f9486-583c-467c-b166-ea071c6a7f38 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:48.243809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281b9e7-56c3-4960-a531-9119ce579849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:48.244767 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281b9e7-56c3-4960-a531-9119ce579849 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:48.245050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281b9e7-56c3-4960-a531-9119ce579849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:48.245365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281b9e7-56c3-4960-a531-9119ce579849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:48.246077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281b9e7-56c3-4960-a531-9119ce579849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:48.248197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281b9e7-56c3-4960-a531-9119ce579849 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:48.267773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1206/2435] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:24:48.268779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281b9e7-56c3-4960-a531-9119ce579849 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:48.281888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281b9e7-56c3-4960-a531-9119ce579849 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:48.307628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8580d15-eff1-4913-9372-06ae31964002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:48.308344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8580d15-eff1-4913-9372-06ae31964002 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:48.308588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8580d15-eff1-4913-9372-06ae31964002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:48.308860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8580d15-eff1-4913-9372-06ae31964002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:48.309521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8580d15-eff1-4913-9372-06ae31964002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:48.311885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8580d15-eff1-4913-9372-06ae31964002 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:48.338340 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1207/2436] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:24:48.342273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8580d15-eff1-4913-9372-06ae31964002 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:48.349397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d4a05-d559-4df9-b6f2-81a42876a866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:48.351673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d4a05-d559-4df9-b6f2-81a42876a866 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:48.363603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8580d15-eff1-4913-9372-06ae31964002 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:48.367381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1230/2437] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:48.377704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eda06-3016-4375-b9f4-82a174a07ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:48.378389 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eda06-3016-4375-b9f4-82a174a07ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:48.378668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eda06-3016-4375-b9f4-82a174a07ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:48.378944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eda06-3016-4375-b9f4-82a174a07ccf admin admin] PATH_INFO: `/v3/projects/b1913bc997784bb7a7a9efed2cd642dd/users/97e6add70c634eb988d3b1c0a65988ea/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:48.411509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eda06-3016-4375-b9f4-82a174a07ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1913bc997784bb7a7a9efed2cd642dd, user_id=97e6add70c634eb988d3b1c0a65988ea, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:48.415422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eda06-3016-4375-b9f4-82a174a07ccf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:48.441938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1208/2438] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:24:48 2022] PUT /identity/v3/projects/b1913bc997784bb7a7a9efed2cd642dd/users/97e6add70c634eb988d3b1c0a65988ea/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:24:48.447717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c452-7f98-4068-90fb-7d766336cd86 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:48.448298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c452-7f98-4068-90fb-7d766336cd86 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:48.448821 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c452-7f98-4068-90fb-7d766336cd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:48.477892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7135c452-7f98-4068-90fb-7d766336cd86 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:48.480250 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7135c452-7f98-4068-90fb-7d766336cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:48.596439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1231/2439] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:24:48.607908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eda06-3016-4375-b9f4-82a174a07ccf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:48.685054 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eda06-3016-4375-b9f4-82a174a07ccf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:48.689625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22259cce-efa1-40eb-831a-32eb33740cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:48.690521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22259cce-efa1-40eb-831a-32eb33740cdd service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:48.690807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22259cce-efa1-40eb-831a-32eb33740cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:48.691087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22259cce-efa1-40eb-831a-32eb33740cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:48.712995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22259cce-efa1-40eb-831a-32eb33740cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:48.715003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22259cce-efa1-40eb-831a-32eb33740cdd service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:48.737894 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1209/2440] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:49.698547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02446173-f1fd-40c0-b1df-deb91b9e533a None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:49.699042 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02446173-f1fd-40c0-b1df-deb91b9e533a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:49.699215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02446173-f1fd-40c0-b1df-deb91b9e533a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:49.741003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-02446173-f1fd-40c0-b1df-deb91b9e533a None None] MFA Rules not processed for user `97e6add70c634eb988d3b1c0a65988ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:49.742330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-02446173-f1fd-40c0-b1df-deb91b9e533a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:49.767556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:49.860067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1232/2441] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:49.883360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22259cce-efa1-40eb-831a-32eb33740cdd service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:49.885922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-22259cce-efa1-40eb-831a-32eb33740cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:50.001953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22259cce-efa1-40eb-831a-32eb33740cdd service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:50.007499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d1359-4423-44a3-862f-3a0f26ae7b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:50.008290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1359-4423-44a3-862f-3a0f26ae7b7c service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:50.008670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1359-4423-44a3-862f-3a0f26ae7b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:50.009044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1359-4423-44a3-862f-3a0f26ae7b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:50.025677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d1359-4423-44a3-862f-3a0f26ae7b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:50.027771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d1359-4423-44a3-862f-3a0f26ae7b7c service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:50.039394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1210/2442] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:51.478560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dfc6b-b1a7-48d4-9cd6-5100ebc3bc0e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:51.479086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dfc6b-b1a7-48d4-9cd6-5100ebc3bc0e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:51.479182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dfc6b-b1a7-48d4-9cd6-5100ebc3bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:51.498685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b66dfc6b-b1a7-48d4-9cd6-5100ebc3bc0e None None] MFA Rules not processed for user `97e6add70c634eb988d3b1c0a65988ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:51.499905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b66dfc6b-b1a7-48d4-9cd6-5100ebc3bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:51.507282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1233/2443] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:53.668161 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58584-4850-4415-833b-c41cb29568f9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:53.668665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58584-4850-4415-833b-c41cb29568f9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:53.668868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58584-4850-4415-833b-c41cb29568f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:53.689214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f4e58584-4850-4415-833b-c41cb29568f9 None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:53.690451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f4e58584-4850-4415-833b-c41cb29568f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:53.741929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:53.754714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1211/2444] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:53.767605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dfc6b-b1a7-48d4-9cd6-5100ebc3bc0e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:53.769082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b66dfc6b-b1a7-48d4-9cd6-5100ebc3bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:53.844034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dfc6b-b1a7-48d4-9cd6-5100ebc3bc0e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:53.849170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e9a5-5560-49a1-9ff7-119bfab617c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:53.850143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e9a5-5560-49a1-9ff7-119bfab617c5 service swift] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:53.850412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e9a5-5560-49a1-9ff7-119bfab617c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:53.850704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e9a5-5560-49a1-9ff7-119bfab617c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:53.859291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63e9a5-5560-49a1-9ff7-119bfab617c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:53.860928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63e9a5-5560-49a1-9ff7-119bfab617c5 service swift] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:53.870244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1234/2445] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:24:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:24:54.644640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e58584-4850-4415-833b-c41cb29568f9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:54.659190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e58584-4850-4415-833b-c41cb29568f9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:54.678499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d98eb9-8d38-4a6e-96d6-ed1bbded1058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:54.682568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d98eb9-8d38-4a6e-96d6-ed1bbded1058 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:54.682568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d98eb9-8d38-4a6e-96d6-ed1bbded1058 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:54.682568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d98eb9-8d38-4a6e-96d6-ed1bbded1058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:54.683762 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f1d98eb9-8d38-4a6e-96d6-ed1bbded1058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:54.794166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d98eb9-8d38-4a6e-96d6-ed1bbded1058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:54.796085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d98eb9-8d38-4a6e-96d6-ed1bbded1058 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:54.811617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1212/2446] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:58.037771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e9a5-5560-49a1-9ff7-119bfab617c5 service swift] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:58.041029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ac63e9a5-5560-49a1-9ff7-119bfab617c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:58.078096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e9a5-5560-49a1-9ff7-119bfab617c5 service swift] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:58.091092 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:58.092912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:58.093199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:58.093475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] PATH_INFO: `/v3/users/cb0fe6fdc48e411787f7754a15895cd6` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:58.096834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0fe6fdc48e411787f7754a15895cd6)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:58.102745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:58.278590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0fe6fdc48e411787f7754a15895cd6'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:58.294565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0fe6fdc48e411787f7754a15895cd6'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:58.313554 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0fe6fdc48e411787f7754a15895cd6'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:58.314566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0fe6fdc48e411787f7754a15895cd6'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:58.315380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0fe6fdc48e411787f7754a15895cd6'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:58.346969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1235/2447] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:24:58 2022] DELETE /identity/v3/users/cb0fe6fdc48e411787f7754a15895cd6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:24:58.353914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaf080-296e-44e3-a034-e425066f7031 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:58.356033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaf080-296e-44e3-a034-e425066f7031 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:58.356501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaf080-296e-44e3-a034-e425066f7031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:58.379431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5faaf080-296e-44e3-a034-e425066f7031 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:24:58.381083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5faaf080-296e-44e3-a034-e425066f7031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:58.472058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1213/2448] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:24:58.497755 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:58.499218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:58.524865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:24:58.618565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580de80-4ed1-47c1-a750-3a34cfbb71e9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:58.627223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5407e0c-37ac-4b75-b15d-d4abcf317ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:58.627962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407e0c-37ac-4b75-b15d-d4abcf317ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:58.628244 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407e0c-37ac-4b75-b15d-d4abcf317ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:58.628519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407e0c-37ac-4b75-b15d-d4abcf317ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:58.639637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5407e0c-37ac-4b75-b15d-d4abcf317ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:58.641033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5407e0c-37ac-4b75-b15d-d4abcf317ae8 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:58.661720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1236/2449] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:24:59.618997 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaf080-296e-44e3-a034-e425066f7031 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:24:59.620569 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5faaf080-296e-44e3-a034-e425066f7031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:24:59.641149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaf080-296e-44e3-a034-e425066f7031 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:24:59.665343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:24:59.667714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:24:59.667714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:24:59.668706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] PATH_INFO: `/v3/projects/c4fc0657db8f425f828cd50af31cd578` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:24:59.670655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fc0657db8f425f828cd50af31cd578)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:24:59.674098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:24:59.739523 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fc0657db8f425f828cd50af31cd578', 'request_id': 'req-758410fe-381e-48fa-be38-a60e15490486'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:59.750474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fc0657db8f425f828cd50af31cd578', 'request_id': 'req-758410fe-381e-48fa-be38-a60e15490486'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:59.759928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fc0657db8f425f828cd50af31cd578', 'request_id': 'req-758410fe-381e-48fa-be38-a60e15490486'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:59.776595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] The token cache is being invalidate because project c4fc0657db8f425f828cd50af31cd578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:24:59.777292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:59.778186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:24:59.790541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1214/2450] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:24:59 2022] DELETE /identity/v3/projects/c4fc0657db8f425f828cd50af31cd578 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:25:08.646976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=18 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:09.771188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:13.962371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060b211-adc4-4059-9335-8c2dc35eb9dc None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:13.963288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060b211-adc4-4059-9335-8c2dc35eb9dc None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:13.963785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060b211-adc4-4059-9335-8c2dc35eb9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:13.987025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-a060b211-adc4-4059-9335-8c2dc35eb9dc None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:25:13.988254 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a060b211-adc4-4059-9335-8c2dc35eb9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:14.040386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1237/2451] 10.222.0.39 () {58 vars in 967 bytes} [Sat Sep 3 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:25:14.064927 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:14.066726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:14.142928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758410fe-381e-48fa-be38-a60e15490486 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:14.148443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458b95b-3805-4bc3-be5d-01a3221f8123 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:14.149253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b95b-3805-4bc3-be5d-01a3221f8123 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:14.149537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b95b-3805-4bc3-be5d-01a3221f8123 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:14.149812 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b95b-3805-4bc3-be5d-01a3221f8123 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:14.158632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458b95b-3805-4bc3-be5d-01a3221f8123 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:14.160453 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458b95b-3805-4bc3-be5d-01a3221f8123 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:14.169297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1215/2452] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:25:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:25:17.839958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a17a5-8236-4e36-acc7-92a845ecd87a None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:17.840445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a17a5-8236-4e36-acc7-92a845ecd87a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:17.840539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a17a5-8236-4e36-acc7-92a845ecd87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:17.860411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2b9a17a5-8236-4e36-acc7-92a845ecd87a None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:25:17.861624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2b9a17a5-8236-4e36-acc7-92a845ecd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:17.869106 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1238/2453] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:25:17.883604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458b95b-3805-4bc3-be5d-01a3221f8123 service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:17.901369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458b95b-3805-4bc3-be5d-01a3221f8123 service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:17.911609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9e62a-b24b-4ba8-b10a-373c9657308c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:17.912230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e62a-b24b-4ba8-b10a-373c9657308c service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:17.912506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e62a-b24b-4ba8-b10a-373c9657308c service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:17.912831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e62a-b24b-4ba8-b10a-373c9657308c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:17.923341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9e62a-b24b-4ba8-b10a-373c9657308c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:17.925909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9e62a-b24b-4ba8-b10a-373c9657308c service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:17.938419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1216/2454] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:25:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:25:20.959624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d21b28-78b1-43df-be0d-871c8449e3d5 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:20.960900 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d21b28-78b1-43df-be0d-871c8449e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:20.961200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d21b28-78b1-43df-be0d-871c8449e3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:20.982419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-67d21b28-78b1-43df-be0d-871c8449e3d5 None None] MFA Rules not processed for user `2b73ee04318147fe923c80760c3b6cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:25:20.983943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-67d21b28-78b1-43df-be0d-871c8449e3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:21.052802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1239/2455] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:25:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:25:27.933555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=38 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:31.040393 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=53 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:36.918692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9e62a-b24b-4ba8-b10a-373c9657308c service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:36.920426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-29c9e62a-b24b-4ba8-b10a-373c9657308c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:37.001449 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9e62a-b24b-4ba8-b10a-373c9657308c service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:37.006800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a771c97-a273-4358-b130-68a3e7ec2b94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:37.007445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a771c97-a273-4358-b130-68a3e7ec2b94 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:37.007723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a771c97-a273-4358-b130-68a3e7ec2b94 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:37.008109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a771c97-a273-4358-b130-68a3e7ec2b94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:37.009808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1a771c97-a273-4358-b130-68a3e7ec2b94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:37.022380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a771c97-a273-4358-b130-68a3e7ec2b94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:37.024182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a771c97-a273-4358-b130-68a3e7ec2b94 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:37.034865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1217/2456] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:25:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:25:43.192630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4833-e245-4eb3-ad90-29191a9b1baf None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:43.193131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4833-e245-4eb3-ad90-29191a9b1baf None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:43.193237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4833-e245-4eb3-ad90-29191a9b1baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:43.212661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7ada4833-e245-4eb3-ad90-29191a9b1baf None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:25:43.213851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7ada4833-e245-4eb3-ad90-29191a9b1baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:43.221563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1240/2457] 10.222.0.39 () {58 vars in 967 bytes} [Sat Sep 3 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:25:43.234794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a771c97-a273-4358-b130-68a3e7ec2b94 service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:43.246073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a771c97-a273-4358-b130-68a3e7ec2b94 service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:43.251050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72e5e8-9235-489e-bcb9-168443a90326 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:43.251726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72e5e8-9235-489e-bcb9-168443a90326 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:43.252004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72e5e8-9235-489e-bcb9-168443a90326 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:43.252275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72e5e8-9235-489e-bcb9-168443a90326 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:43.260511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72e5e8-9235-489e-bcb9-168443a90326 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:43.262028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72e5e8-9235-489e-bcb9-168443a90326 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:43.270517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1218/2458] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:25:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:25:45.471753 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990a91c-4184-434f-aaff-456668ca986d None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:45.472758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990a91c-4184-434f-aaff-456668ca986d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:45.473567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990a91c-4184-434f-aaff-456668ca986d None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:45.475133 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1241/2459] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:25:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 01:25:45.485814 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655abb8-8fd4-4b4d-a1a8-6eeb97ed471c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:45.486251 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655abb8-8fd4-4b4d-a1a8-6eeb97ed471c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:45.486534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655abb8-8fd4-4b4d-a1a8-6eeb97ed471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:45.512398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4655abb8-8fd4-4b4d-a1a8-6eeb97ed471c None None] MFA Rules not processed for user `bac171ccd62b4c268e79a318478414ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:25:45.516272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4655abb8-8fd4-4b4d-a1a8-6eeb97ed471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:45.529780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1219/2460] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:25:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:25:45.549976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990a91c-4184-434f-aaff-456668ca986d None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:45.580500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655abb8-8fd4-4b4d-a1a8-6eeb97ed471c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:45.587993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4655abb8-8fd4-4b4d-a1a8-6eeb97ed471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:45.589450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990a91c-4184-434f-aaff-456668ca986d None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:45.596015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17def7f-31a6-4d73-8068-3822dac28813 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:45.596897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17def7f-31a6-4d73-8068-3822dac28813 service placement] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:45.597256 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17def7f-31a6-4d73-8068-3822dac28813 service placement] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:45.597677 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17def7f-31a6-4d73-8068-3822dac28813 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:45.608418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17def7f-31a6-4d73-8068-3822dac28813 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:45.610570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17def7f-31a6-4d73-8068-3822dac28813 service placement] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:45.624042 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1242/2461] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:25:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:25:45.679573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655abb8-8fd4-4b4d-a1a8-6eeb97ed471c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:45.685286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:45.686353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:45.686353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:45.686640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] PATH_INFO: `/v3/users/2385fbc44aa94487b0dc4f383e99e4c2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:45.688168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2385fbc44aa94487b0dc4f383e99e4c2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:45.690066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:45.744570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2385fbc44aa94487b0dc4f383e99e4c2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:25:45.757014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2385fbc44aa94487b0dc4f383e99e4c2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:25:45.763521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:45.765473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2385fbc44aa94487b0dc4f383e99e4c2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:25:45.766250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2385fbc44aa94487b0dc4f383e99e4c2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:25:45.766893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5808386c-90a1-4aa2-80e4-0e5487e10888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2385fbc44aa94487b0dc4f383e99e4c2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:25:45.783585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1220/2462] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:25:45 2022] DELETE /identity/v3/users/2385fbc44aa94487b0dc4f383e99e4c2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:25:46.006074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17def7f-31a6-4d73-8068-3822dac28813 service placement] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:46.024912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17def7f-31a6-4d73-8068-3822dac28813 service placement] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:46.089768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:46.090317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:46.090591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:46.090860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] PATH_INFO: `/v3/projects/ddbde1d8568d4dbd9562ff9d1b2d0e10` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:46.092543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddbde1d8568d4dbd9562ff9d1b2d0e10)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:46.094467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:46.161562 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddbde1d8568d4dbd9562ff9d1b2d0e10', 'request_id': 'req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:25:46.170802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddbde1d8568d4dbd9562ff9d1b2d0e10', 'request_id': 'req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:25:46.178984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddbde1d8568d4dbd9562ff9d1b2d0e10', 'request_id': 'req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:25:46.192422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] The token cache is being invalidate because project ddbde1d8568d4dbd9562ff9d1b2d0e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:25:46.192673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:25:46.193442 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:25:46.195111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1243/2463] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:25:46 2022] DELETE /identity/v3/projects/ddbde1d8568d4dbd9562ff9d1b2d0e10 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:25:46.511659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18cd6a-e4cb-45ba-8f5c-42f45a9193d9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:46.512629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18cd6a-e4cb-45ba-8f5c-42f45a9193d9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:46.512629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18cd6a-e4cb-45ba-8f5c-42f45a9193d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:46.540157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ec18cd6a-e4cb-45ba-8f5c-42f45a9193d9 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:25:46.541353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ec18cd6a-e4cb-45ba-8f5c-42f45a9193d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:46.605653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1221/2464] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:25:46.622324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:46.623773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:46.701009 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d6c69-bff7-41d0-be8c-b4056cb67d53 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:46.706924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dea75b-72f8-40fe-9691-4e4935080dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:46.707579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dea75b-72f8-40fe-9691-4e4935080dda service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:46.707863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dea75b-72f8-40fe-9691-4e4935080dda service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:46.708143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dea75b-72f8-40fe-9691-4e4935080dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:46.714854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:46.717301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dea75b-72f8-40fe-9691-4e4935080dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:46.719166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dea75b-72f8-40fe-9691-4e4935080dda service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:46.730577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1244/2465] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:25:49.590773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19ae3-26de-4f64-aed0-06e40521165d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:49.591422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19ae3-26de-4f64-aed0-06e40521165d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:49.591422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19ae3-26de-4f64-aed0-06e40521165d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:49.613720 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b2c19ae3-26de-4f64-aed0-06e40521165d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:25:49.614925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b2c19ae3-26de-4f64-aed0-06e40521165d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:49.624540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1222/2466] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:25:49.643637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dea75b-72f8-40fe-9691-4e4935080dda service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:49.645844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-63dea75b-72f8-40fe-9691-4e4935080dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:49.664964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dea75b-72f8-40fe-9691-4e4935080dda service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:49.673232 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c643ee-6389-45b3-878c-08b60a51bd8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:49.673958 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c643ee-6389-45b3-878c-08b60a51bd8b service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:49.674184 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c643ee-6389-45b3-878c-08b60a51bd8b service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:49.674447 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c643ee-6389-45b3-878c-08b60a51bd8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:49.686680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c643ee-6389-45b3-878c-08b60a51bd8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:49.688297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c643ee-6389-45b3-878c-08b60a51bd8b service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:49.698991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1245/2467] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:25:52.830028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01560-0d9f-4d3a-b79b-0493fd7a5002 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:52.830615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01560-0d9f-4d3a-b79b-0493fd7a5002 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:52.830615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01560-0d9f-4d3a-b79b-0493fd7a5002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:52.851435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e3e01560-0d9f-4d3a-b79b-0493fd7a5002 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:25:52.852800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e3e01560-0d9f-4d3a-b79b-0493fd7a5002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:52.864185 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1223/2468] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:25:52.880367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c643ee-6389-45b3-878c-08b60a51bd8b service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:52.892136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c643ee-6389-45b3-878c-08b60a51bd8b service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:52.898601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48565d98-cf73-476a-a2af-41c1cb6f4699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:52.899325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48565d98-cf73-476a-a2af-41c1cb6f4699 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:52.899666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48565d98-cf73-476a-a2af-41c1cb6f4699 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:52.899997 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48565d98-cf73-476a-a2af-41c1cb6f4699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:52.909435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48565d98-cf73-476a-a2af-41c1cb6f4699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:52.910599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48565d98-cf73-476a-a2af-41c1cb6f4699 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:52.921076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1246/2469] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:25:55.948682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a7f5a-d065-4bd4-b976-7f1e5be422ba None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:55.949164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a7f5a-d065-4bd4-b976-7f1e5be422ba None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:55.949164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a7f5a-d065-4bd4-b976-7f1e5be422ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:55.970766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e25a7f5a-d065-4bd4-b976-7f1e5be422ba None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:25:55.972373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e25a7f5a-d065-4bd4-b976-7f1e5be422ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:55.982118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1224/2470] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:25:56.002978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48565d98-cf73-476a-a2af-41c1cb6f4699 service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:56.018287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48565d98-cf73-476a-a2af-41c1cb6f4699 service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:56.025497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d93aab-6970-4b5a-9cd1-c136d7c74713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:56.026091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d93aab-6970-4b5a-9cd1-c136d7c74713 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:56.026366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d93aab-6970-4b5a-9cd1-c136d7c74713 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:56.026632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d93aab-6970-4b5a-9cd1-c136d7c74713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:56.035645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d93aab-6970-4b5a-9cd1-c136d7c74713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:56.037225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d93aab-6970-4b5a-9cd1-c136d7c74713 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:56.046941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1247/2471] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:25:59.119496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fd8ad-3855-4009-b460-b35aa2a80843 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:59.120030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fd8ad-3855-4009-b460-b35aa2a80843 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:59.120030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fd8ad-3855-4009-b460-b35aa2a80843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:59.141325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0e1fd8ad-3855-4009-b460-b35aa2a80843 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:25:59.142545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0e1fd8ad-3855-4009-b460-b35aa2a80843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:25:59.151815 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1225/2472] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:25:59.168826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d93aab-6970-4b5a-9cd1-c136d7c74713 service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:25:59.181754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d93aab-6970-4b5a-9cd1-c136d7c74713 service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:25:59.189036 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88145b5d-830c-4647-9d64-9277b78b15ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:25:59.189642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88145b5d-830c-4647-9d64-9277b78b15ac service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:25:59.189907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88145b5d-830c-4647-9d64-9277b78b15ac service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:25:59.190172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88145b5d-830c-4647-9d64-9277b78b15ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:25:59.199301 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88145b5d-830c-4647-9d64-9277b78b15ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:25:59.200906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88145b5d-830c-4647-9d64-9277b78b15ac service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:25:59.211417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1248/2473] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:26:02.299013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb0f24-b4d5-45b5-8105-bcda90cc2cb4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:02.300003 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb0f24-b4d5-45b5-8105-bcda90cc2cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:02.300269 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb0f24-b4d5-45b5-8105-bcda90cc2cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:02.322573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-57cb0f24-b4d5-45b5-8105-bcda90cc2cb4 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:26:02.324222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-57cb0f24-b4d5-45b5-8105-bcda90cc2cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:26:02.334263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1226/2474] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:26:02.350722 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88145b5d-830c-4647-9d64-9277b78b15ac service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:26:02.362317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88145b5d-830c-4647-9d64-9277b78b15ac service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:26:02.367903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c905e-8f58-4983-acb2-155019d4b1ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:26:02.368518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c905e-8f58-4983-acb2-155019d4b1ca service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:02.368798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c905e-8f58-4983-acb2-155019d4b1ca service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:02.369077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c905e-8f58-4983-acb2-155019d4b1ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:02.378074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c905e-8f58-4983-acb2-155019d4b1ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:26:02.379798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c905e-8f58-4983-acb2-155019d4b1ca service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:26:02.390349 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1249/2475] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:26:12.316510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=45,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:26:12.385564 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=32 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:26:21.293020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fa80c-83fb-4b7a-b625-f294a598db4e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:21.293575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fa80c-83fb-4b7a-b625-f294a598db4e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:21.293575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fa80c-83fb-4b7a-b625-f294a598db4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:21.314417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4d4fa80c-83fb-4b7a-b625-f294a598db4e None None] MFA Rules not processed for user `97e6add70c634eb988d3b1c0a65988ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:26:21.315688 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4d4fa80c-83fb-4b7a-b625-f294a598db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:26:21.379084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1227/2476] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:26:21.699963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5aadc-3444-4f6b-80ae-6e7ce79bcc29 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:21.700497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5aadc-3444-4f6b-80ae-6e7ce79bcc29 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:21.700497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5aadc-3444-4f6b-80ae-6e7ce79bcc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:21.720579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3fb5aadc-3444-4f6b-80ae-6e7ce79bcc29 None None] MFA Rules not processed for user `9c6321d3fb5d4265aaff699fae301ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:26:21.722129 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3fb5aadc-3444-4f6b-80ae-6e7ce79bcc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:26:21.780213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1250/2477] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:26:28.253544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108725e-3122-414f-a084-201acdfa8a85 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:28.254204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108725e-3122-414f-a084-201acdfa8a85 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:28.254204 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108725e-3122-414f-a084-201acdfa8a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:28.277490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5108725e-3122-414f-a084-201acdfa8a85 None None] MFA Rules not processed for user `1d959b149003454c83105a7ed6ad7003`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:26:28.279006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5108725e-3122-414f-a084-201acdfa8a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:26:28.336264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1228/2478] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:26:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:26:31.771765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=25 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:26:38.287590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410c07-8c32-486c-954c-7c6973ab6624 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:38.288614 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410c07-8c32-486c-954c-7c6973ab6624 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:38.288929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410c07-8c32-486c-954c-7c6973ab6624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:38.312460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-19410c07-8c32-486c-954c-7c6973ab6624 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:26:38.313707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-19410c07-8c32-486c-954c-7c6973ab6624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:26:38.323208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1251/2479] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:26:38.329311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=50 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:26:38.338591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108725e-3122-414f-a084-201acdfa8a85 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:26:38.353497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108725e-3122-414f-a084-201acdfa8a85 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:26:38.360078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208894f6-b507-4e4d-9ddf-8abe234f8ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:26:38.360701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208894f6-b507-4e4d-9ddf-8abe234f8ae7 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:38.361071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208894f6-b507-4e4d-9ddf-8abe234f8ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:38.361247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208894f6-b507-4e4d-9ddf-8abe234f8ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:38.370910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208894f6-b507-4e4d-9ddf-8abe234f8ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:26:38.372541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208894f6-b507-4e4d-9ddf-8abe234f8ae7 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:26:38.384203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1229/2480] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:26:41.595618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dac490-215d-499a-9203-ebe6458f4bb0 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:41.596567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dac490-215d-499a-9203-ebe6458f4bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:41.596567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dac490-215d-499a-9203-ebe6458f4bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:41.616902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b4dac490-215d-499a-9203-ebe6458f4bb0 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:26:41.618095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b4dac490-215d-499a-9203-ebe6458f4bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:26:41.627596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1252/2481] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:26:41.646647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208894f6-b507-4e4d-9ddf-8abe234f8ae7 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:26:41.658112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208894f6-b507-4e4d-9ddf-8abe234f8ae7 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:26:41.664202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ca89-213a-47cc-91bf-a54a942053d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:26:41.664719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ca89-213a-47cc-91bf-a54a942053d5 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:41.664994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ca89-213a-47cc-91bf-a54a942053d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:41.665261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ca89-213a-47cc-91bf-a54a942053d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:41.673607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0ca89-213a-47cc-91bf-a54a942053d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:26:41.675139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0ca89-213a-47cc-91bf-a54a942053d5 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:26:41.684674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1230/2482] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:26:45.752320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e6af6-fcb6-4a66-8038-854dd2f288a3 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:45.752829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e6af6-fcb6-4a66-8038-854dd2f288a3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:45.752930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e6af6-fcb6-4a66-8038-854dd2f288a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:45.775789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f65e6af6-fcb6-4a66-8038-854dd2f288a3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:26:45.777325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f65e6af6-fcb6-4a66-8038-854dd2f288a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:26:45.785942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1253/2483] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:26:45.802329 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ca89-213a-47cc-91bf-a54a942053d5 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:26:45.815175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ca89-213a-47cc-91bf-a54a942053d5 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:26:45.821156 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694570a-1da4-45e5-a8fd-87d015476cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:26:45.822146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694570a-1da4-45e5-a8fd-87d015476cb0 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:45.822513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694570a-1da4-45e5-a8fd-87d015476cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:45.822896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694570a-1da4-45e5-a8fd-87d015476cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:45.832304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694570a-1da4-45e5-a8fd-87d015476cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:26:45.834138 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694570a-1da4-45e5-a8fd-87d015476cb0 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:26:45.844676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1231/2484] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:26:48.963417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a36e17-59b5-4f96-8404-83f807c1dd6d None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:48.964189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a36e17-59b5-4f96-8404-83f807c1dd6d None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:48.964525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a36e17-59b5-4f96-8404-83f807c1dd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:48.985603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-71a36e17-59b5-4f96-8404-83f807c1dd6d None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:26:48.986796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-71a36e17-59b5-4f96-8404-83f807c1dd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:26:48.995784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1254/2485] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:26:49.017226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694570a-1da4-45e5-a8fd-87d015476cb0 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:26:49.029378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694570a-1da4-45e5-a8fd-87d015476cb0 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:26:49.035788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d52124-251e-4678-8805-23940ab6e231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:26:49.036394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d52124-251e-4678-8805-23940ab6e231 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:49.036672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d52124-251e-4678-8805-23940ab6e231 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:49.036941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d52124-251e-4678-8805-23940ab6e231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:49.046404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d52124-251e-4678-8805-23940ab6e231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:26:49.048038 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d52124-251e-4678-8805-23940ab6e231 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:26:49.058416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1232/2486] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:26:52.117293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c5913-105b-4864-bede-f856d121193f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:52.117830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c5913-105b-4864-bede-f856d121193f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:52.117830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c5913-105b-4864-bede-f856d121193f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:52.137939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3c5c5913-105b-4864-bede-f856d121193f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:26:52.139125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3c5c5913-105b-4864-bede-f856d121193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:26:52.148417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1255/2487] 10.222.0.27 () {58 vars in 1016 bytes} [Sat Sep 3 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:26:52.165573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d52124-251e-4678-8805-23940ab6e231 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:26:52.177604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d52124-251e-4678-8805-23940ab6e231 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:26:52.184667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8b20-b619-4f8e-bf37-8d7b4309852e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:26:52.185275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8b20-b619-4f8e-bf37-8d7b4309852e service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:26:52.185549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8b20-b619-4f8e-bf37-8d7b4309852e service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:26:52.185819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8b20-b619-4f8e-bf37-8d7b4309852e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:26:52.195310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb8b20-b619-4f8e-bf37-8d7b4309852e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:26:52.196911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb8b20-b619-4f8e-bf37-8d7b4309852e service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:26:52.207028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1233/2488] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:27:02.132728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=15 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:02.202670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=30 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:09.099802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720356f-78d3-4460-8f2f-ac0aeb89b604 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:09.100612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720356f-78d3-4460-8f2f-ac0aeb89b604 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:09.100881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720356f-78d3-4460-8f2f-ac0aeb89b604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:09.121477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-1720356f-78d3-4460-8f2f-ac0aeb89b604 None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:27:09.122675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1720356f-78d3-4460-8f2f-ac0aeb89b604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:09.145719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3757-8921-4dfc-b608-b4a791cbb3d4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:09.146242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3757-8921-4dfc-b608-b4a791cbb3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:09.146242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3757-8921-4dfc-b608-b4a791cbb3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:09.165684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-127e3757-8921-4dfc-b608-b4a791cbb3d4 None None] MFA Rules not processed for user `2b73ee04318147fe923c80760c3b6cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:27:09.167022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-127e3757-8921-4dfc-b608-b4a791cbb3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:09.187422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1256/2489] 10.222.0.39 () {58 vars in 967 bytes} [Sat Sep 3 01:27:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:27:09.238825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1234/2490] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:27:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:27:09.242363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720356f-78d3-4460-8f2f-ac0aeb89b604 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:09.244096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1720356f-78d3-4460-8f2f-ac0aeb89b604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:09.363751 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720356f-78d3-4460-8f2f-ac0aeb89b604 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:09.380418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc69c2-a8c7-4d69-b0a5-e642fcbd3ebe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:09.381073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc69c2-a8c7-4d69-b0a5-e642fcbd3ebe service swift] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:09.381358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc69c2-a8c7-4d69-b0a5-e642fcbd3ebe service swift] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:09.381686 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc69c2-a8c7-4d69-b0a5-e642fcbd3ebe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:09.398724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc69c2-a8c7-4d69-b0a5-e642fcbd3ebe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:09.402364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc69c2-a8c7-4d69-b0a5-e642fcbd3ebe service swift] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:09.412957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1257/2491] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:27:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:27:17.185708 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e3757-8921-4dfc-b608-b4a791cbb3d4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:17.187451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-127e3757-8921-4dfc-b608-b4a791cbb3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:17.204410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e3757-8921-4dfc-b608-b4a791cbb3d4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:17.209653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:17.210404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:17.211335 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:17.211727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] PATH_INFO: `/v3/users/4b2683d66665426e8a60614971b04bcc` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:17.213031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2683d66665426e8a60614971b04bcc)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:17.215214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:17.265114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2683d66665426e8a60614971b04bcc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.279415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2683d66665426e8a60614971b04bcc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.286270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2683d66665426e8a60614971b04bcc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.287110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2683d66665426e8a60614971b04bcc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.287817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2683d66665426e8a60614971b04bcc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.302365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1235/2492] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:27:17 2022] DELETE /identity/v3/users/4b2683d66665426e8a60614971b04bcc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:27:17.482353 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc69c2-a8c7-4d69-b0a5-e642fcbd3ebe service swift] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:17.495478 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc69c2-a8c7-4d69-b0a5-e642fcbd3ebe service swift] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:17.553371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:17.553916 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:17.554194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:17.554514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] PATH_INFO: `/v3/projects/614435d56a644c87851652912f77eafb` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:17.555678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=614435d56a644c87851652912f77eafb)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:17.557589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:17.598122 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:17.608974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614435d56a644c87851652912f77eafb', 'request_id': 'req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.618441 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614435d56a644c87851652912f77eafb', 'request_id': 'req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.625336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614435d56a644c87851652912f77eafb', 'request_id': 'req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.636940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] The token cache is being invalidate because project 614435d56a644c87851652912f77eafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:27:17.637233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.637876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.639399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1258/2493] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:27:17 2022] DELETE /identity/v3/projects/614435d56a644c87851652912f77eafb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:27:17.643586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:17.645037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:17.659101 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6fd3f-0722-44b9-998c-eeedb6d6aa52 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:17.717440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:17.718067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:17.718342 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:17.718617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] PATH_INFO: `/v3/users/2aaaf9e14852450bb994c8465029c9ad` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:17.720133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aaaf9e14852450bb994c8465029c9ad)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:17.722039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:17.743170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:17.771619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aaaf9e14852450bb994c8465029c9ad'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.783331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aaaf9e14852450bb994c8465029c9ad'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.790294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aaaf9e14852450bb994c8465029c9ad'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.791009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aaaf9e14852450bb994c8465029c9ad'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.791665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aaaf9e14852450bb994c8465029c9ad'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:17.806790 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1236/2494] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:27:17 2022] DELETE /identity/v3/users/2aaaf9e14852450bb994c8465029c9ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:27:17.984112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:17.985622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:17.999642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd7e6b-e5f4-4225-9707-7cbcdbbf1ac3 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:18.062970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:18.063504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:18.063787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:18.064058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] PATH_INFO: `/v3/projects/f251b50bc93146fd97b220907dfeaf84` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:18.065399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f251b50bc93146fd97b220907dfeaf84)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:18.067354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:18.117085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f251b50bc93146fd97b220907dfeaf84', 'request_id': 'req-9a583f87-753e-4649-8b4a-8c8b0588a628'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:18.126279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f251b50bc93146fd97b220907dfeaf84', 'request_id': 'req-9a583f87-753e-4649-8b4a-8c8b0588a628'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:18.132700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f251b50bc93146fd97b220907dfeaf84', 'request_id': 'req-9a583f87-753e-4649-8b4a-8c8b0588a628'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:18.144098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] The token cache is being invalidate because project f251b50bc93146fd97b220907dfeaf84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:27:18.144394 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:18.145198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:18.146784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1259/2495] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:27:17 2022] DELETE /identity/v3/projects/f251b50bc93146fd97b220907dfeaf84 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:27:21.929380 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:21.930888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:21.946431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb185-9ccc-4734-80d8-b9fe118ab49f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:22.006766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:22.007316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:22.007595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:22.007860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] PATH_INFO: `/v3/users/97e6add70c634eb988d3b1c0a65988ea` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:22.009012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e6add70c634eb988d3b1c0a65988ea)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:22.011094 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:22.061904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e6add70c634eb988d3b1c0a65988ea'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:22.074409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e6add70c634eb988d3b1c0a65988ea'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:22.082541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e6add70c634eb988d3b1c0a65988ea'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:22.083350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e6add70c634eb988d3b1c0a65988ea'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:22.084046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e6add70c634eb988d3b1c0a65988ea'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:22.101227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1237/2496] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:27:21 2022] DELETE /identity/v3/users/97e6add70c634eb988d3b1c0a65988ea => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:27:22.281305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:22.282825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:22.308555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a583f87-753e-4649-8b4a-8c8b0588a628 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:22.364913 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:22.374359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:22.374953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:22.375350 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:22.375547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] PATH_INFO: `/v3/projects/b1913bc997784bb7a7a9efed2cd642dd` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:22.376684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1913bc997784bb7a7a9efed2cd642dd)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:22.378696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:22.434040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1913bc997784bb7a7a9efed2cd642dd', 'request_id': 'req-2e490643-9ab9-4ced-819c-f65c77860db5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:22.448809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1913bc997784bb7a7a9efed2cd642dd', 'request_id': 'req-2e490643-9ab9-4ced-819c-f65c77860db5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:22.456957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1913bc997784bb7a7a9efed2cd642dd', 'request_id': 'req-2e490643-9ab9-4ced-819c-f65c77860db5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:22.467653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] The token cache is being invalidate because project b1913bc997784bb7a7a9efed2cd642dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:27:22.467942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:22.468602 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:22.470656 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1260/2497] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:27:22 2022] DELETE /identity/v3/projects/b1913bc997784bb7a7a9efed2cd642dd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:27:27.259982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:27.261642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:27.281314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:27.327070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4537a9-3e83-4dc0-9827-9e5e5db9914c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:27.377310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b8960-a1d0-46f2-b610-2fb5d7bf12d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:27.377929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8960-a1d0-46f2-b610-2fb5d7bf12d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:27.378210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8960-a1d0-46f2-b610-2fb5d7bf12d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:27.378507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8960-a1d0-46f2-b610-2fb5d7bf12d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:27.380437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ca9b8960-a1d0-46f2-b610-2fb5d7bf12d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:27.451123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b8960-a1d0-46f2-b610-2fb5d7bf12d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:27.452676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b8960-a1d0-46f2-b610-2fb5d7bf12d2 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:27.464344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1238/2498] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:27:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:27:28.674763 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:28.676245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:28.691086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e490643-9ab9-4ced-819c-f65c77860db5 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:28.694956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b21cf2-c88f-4ef3-96da-861d1d3351f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:28.695606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b21cf2-c88f-4ef3-96da-861d1d3351f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:28.695886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b21cf2-c88f-4ef3-96da-861d1d3351f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:28.696156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b21cf2-c88f-4ef3-96da-861d1d3351f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:28.697989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-51b21cf2-c88f-4ef3-96da-861d1d3351f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:28.712375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b21cf2-c88f-4ef3-96da-861d1d3351f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:28.713802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b21cf2-c88f-4ef3-96da-861d1d3351f3 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:28.725222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1261/2499] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:27:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:27:35.786186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb86a9-ff3b-4177-81a1-7368470c9664 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:35.786700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb86a9-ff3b-4177-81a1-7368470c9664 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:35.786700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb86a9-ff3b-4177-81a1-7368470c9664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:35.807165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6cbb86a9-ff3b-4177-81a1-7368470c9664 None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:27:35.808819 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6cbb86a9-ff3b-4177-81a1-7368470c9664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:35.872996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1239/2500] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:27:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:27:35.887413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b21cf2-c88f-4ef3-96da-861d1d3351f3 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:35.889125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-51b21cf2-c88f-4ef3-96da-861d1d3351f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:35.962215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b21cf2-c88f-4ef3-96da-861d1d3351f3 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:35.967120 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd2511-0544-4374-81ca-7feec15777df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:35.967776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd2511-0544-4374-81ca-7feec15777df service swift] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:35.968083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd2511-0544-4374-81ca-7feec15777df service swift] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:35.968354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd2511-0544-4374-81ca-7feec15777df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:35.977119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd2511-0544-4374-81ca-7feec15777df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:35.978705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd2511-0544-4374-81ca-7feec15777df service swift] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:35.988657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1262/2501] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:27:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:27:40.686438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb86a9-ff3b-4177-81a1-7368470c9664 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:40.688445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6cbb86a9-ff3b-4177-81a1-7368470c9664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:40.715874 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:40.768169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb86a9-ff3b-4177-81a1-7368470c9664 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:40.773551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161a07-da53-4a04-9bba-b611c58f8465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:40.774248 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161a07-da53-4a04-9bba-b611c58f8465 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:40.774599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161a07-da53-4a04-9bba-b611c58f8465 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:40.774988 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161a07-da53-4a04-9bba-b611c58f8465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:40.777341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5a161a07-da53-4a04-9bba-b611c58f8465 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:40.831402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd2511-0544-4374-81ca-7feec15777df service swift] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:40.833919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-fecd2511-0544-4374-81ca-7feec15777df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:40.853610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd2511-0544-4374-81ca-7feec15777df service swift] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:40.860355 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff93a45-0035-4234-9d8a-7b7405632cc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:40.861391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff93a45-0035-4234-9d8a-7b7405632cc5 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:40.861904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff93a45-0035-4234-9d8a-7b7405632cc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:40.862217 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff93a45-0035-4234-9d8a-7b7405632cc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:40.866394 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9ff93a45-0035-4234-9d8a-7b7405632cc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:40.874241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a161a07-da53-4a04-9bba-b611c58f8465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:40.876991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a161a07-da53-4a04-9bba-b611c58f8465 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:40.896509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1240/2502] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:27:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:27:40.968262 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff93a45-0035-4234-9d8a-7b7405632cc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:40.970780 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff93a45-0035-4234-9d8a-7b7405632cc5 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:40.976803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:40.993481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1263/2503] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:27:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:27:49.452343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161a07-da53-4a04-9bba-b611c58f8465 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:49.454070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5a161a07-da53-4a04-9bba-b611c58f8465 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:49.467348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161a07-da53-4a04-9bba-b611c58f8465 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:49.472296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5e378-dbd7-4173-9d54-fd4755615b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:49.472897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e378-dbd7-4173-9d54-fd4755615b62 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:49.473173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e378-dbd7-4173-9d54-fd4755615b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:49.473443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e378-dbd7-4173-9d54-fd4755615b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:49.475291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-61f5e378-dbd7-4173-9d54-fd4755615b62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:49.484914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5e378-dbd7-4173-9d54-fd4755615b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:49.486457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5e378-dbd7-4173-9d54-fd4755615b62 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:49.494821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1241/2504] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:27:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:27:49.854194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff93a45-0035-4234-9d8a-7b7405632cc5 service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:49.855648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9ff93a45-0035-4234-9d8a-7b7405632cc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:49.929085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff93a45-0035-4234-9d8a-7b7405632cc5 service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:49.936522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46daf70-d128-43d7-84ae-10deb185ef94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:49.937165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46daf70-d128-43d7-84ae-10deb185ef94 service placement] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:49.937446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46daf70-d128-43d7-84ae-10deb185ef94 service placement] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:49.937719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46daf70-d128-43d7-84ae-10deb185ef94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:49.939787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c46daf70-d128-43d7-84ae-10deb185ef94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:49.955457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46daf70-d128-43d7-84ae-10deb185ef94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:49.957519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46daf70-d128-43d7-84ae-10deb185ef94 service placement] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:49.968167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1264/2505] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:27:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:27:50.854909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5e378-dbd7-4173-9d54-fd4755615b62 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:50.864176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5e378-dbd7-4173-9d54-fd4755615b62 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:50.868079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb0397-0a6a-42c2-bd60-93337ad1d5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:50.868744 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb0397-0a6a-42c2-bd60-93337ad1d5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:50.869116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb0397-0a6a-42c2-bd60-93337ad1d5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:50.869554 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb0397-0a6a-42c2-bd60-93337ad1d5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:50.871391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d4cb0397-0a6a-42c2-bd60-93337ad1d5c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:50.882022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb0397-0a6a-42c2-bd60-93337ad1d5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:50.883501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb0397-0a6a-42c2-bd60-93337ad1d5c7 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:50.891558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1242/2506] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:27:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:27:51.089407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46daf70-d128-43d7-84ae-10deb185ef94 service placement] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:51.099557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46daf70-d128-43d7-84ae-10deb185ef94 service placement] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:51.103140 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e279d-7c05-424d-b064-e2f91d61294e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:51.103894 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e279d-7c05-424d-b064-e2f91d61294e service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:51.104207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e279d-7c05-424d-b064-e2f91d61294e service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:51.104572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e279d-7c05-424d-b064-e2f91d61294e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:51.106404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ef8e279d-7c05-424d-b064-e2f91d61294e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:51.171795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e279d-7c05-424d-b064-e2f91d61294e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:51.173247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e279d-7c05-424d-b064-e2f91d61294e service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:51.185898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1265/2507] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:27:51.656220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf879d-2f67-4ca1-8ce8-0aa3a6f1f3cf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:51.656528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf879d-2f67-4ca1-8ce8-0aa3a6f1f3cf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:51.656789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf879d-2f67-4ca1-8ce8-0aa3a6f1f3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:51.676445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cfdf879d-2f67-4ca1-8ce8-0aa3a6f1f3cf None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:27:51.677660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cfdf879d-2f67-4ca1-8ce8-0aa3a6f1f3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:51.685113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1243/2508] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Sep 3 01:27:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:27:51.698382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e279d-7c05-424d-b064-e2f91d61294e service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:51.710203 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e279d-7c05-424d-b064-e2f91d61294e service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:51.715331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a6b0b-6610-4c39-a938-bd013e615196 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:51.716004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a6b0b-6610-4c39-a938-bd013e615196 service swift] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:51.716273 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a6b0b-6610-4c39-a938-bd013e615196 service swift] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:51.716544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a6b0b-6610-4c39-a938-bd013e615196 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:51.725454 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a6b0b-6610-4c39-a938-bd013e615196 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:51.727038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a6b0b-6610-4c39-a938-bd013e615196 service swift] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:51.735155 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1266/2509] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:27:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:27:55.153259 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf879d-2f67-4ca1-8ce8-0aa3a6f1f3cf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:55.155079 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cfdf879d-2f67-4ca1-8ce8-0aa3a6f1f3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:55.182047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf879d-2f67-4ca1-8ce8-0aa3a6f1f3cf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:55.186539 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:55.188082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:55.188592 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:55.189166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] PATH_INFO: `/v3/users/1d959b149003454c83105a7ed6ad7003` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:55.190685 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d959b149003454c83105a7ed6ad7003)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:55.193015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:55.310640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d959b149003454c83105a7ed6ad7003'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:55.327871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d959b149003454c83105a7ed6ad7003'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:55.337084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d959b149003454c83105a7ed6ad7003'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:55.337798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d959b149003454c83105a7ed6ad7003'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:55.338400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-255c7bf3-f760-49d5-baee-b5a043b7ef65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d959b149003454c83105a7ed6ad7003'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:55.367513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1244/2510] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:27:55 2022] DELETE /identity/v3/users/1d959b149003454c83105a7ed6ad7003 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:27:55.579023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a6b0b-6610-4c39-a938-bd013e615196 service swift] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:55.606911 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a6b0b-6610-4c39-a938-bd013e615196 service swift] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:55.682363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:55.683084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:55.683401 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:55.683705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] PATH_INFO: `/v3/projects/c1488a0b9eb4434b9e78a48cb951c82c` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:55.684895 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1488a0b9eb4434b9e78a48cb951c82c)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:55.686878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:55.703574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:55.747618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1488a0b9eb4434b9e78a48cb951c82c', 'request_id': 'req-4b3d8c66-707c-48e9-a79f-168ed3d901c5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:55.767719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1488a0b9eb4434b9e78a48cb951c82c', 'request_id': 'req-4b3d8c66-707c-48e9-a79f-168ed3d901c5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:55.776533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1488a0b9eb4434b9e78a48cb951c82c', 'request_id': 'req-4b3d8c66-707c-48e9-a79f-168ed3d901c5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:55.795748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] The token cache is being invalidate because project c1488a0b9eb4434b9e78a48cb951c82c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:27:55.797007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:55.797855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4b3d8c66-707c-48e9-a79f-168ed3d901c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:27:55.803292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1267/2511] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:27:55 2022] DELETE /identity/v3/projects/c1488a0b9eb4434b9e78a48cb951c82c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:27:55.808494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56b39-2812-4ccd-9c86-98840a14229e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:55.808494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56b39-2812-4ccd-9c86-98840a14229e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:55.808494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56b39-2812-4ccd-9c86-98840a14229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:55.829534 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-eea56b39-2812-4ccd-9c86-98840a14229e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:27:55.831082 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eea56b39-2812-4ccd-9c86-98840a14229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:55.839536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:55.915802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1245/2512] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:27:55.923572 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f82b6-f874-4438-9f19-982231b71422 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:55.924088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f82b6-f874-4438-9f19-982231b71422 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:55.924354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f82b6-f874-4438-9f19-982231b71422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:55.945047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-238f82b6-f874-4438-9f19-982231b71422 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:27:55.946387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-238f82b6-f874-4438-9f19-982231b71422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:55.954535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1268/2513] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:27:55.958965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea56b39-2812-4ccd-9c86-98840a14229e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:55.969957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea56b39-2812-4ccd-9c86-98840a14229e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:55.977327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450daf-7958-4f4a-907e-7aee30b46649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:55.977545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450daf-7958-4f4a-907e-7aee30b46649 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:55.977785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450daf-7958-4f4a-907e-7aee30b46649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:55.978061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450daf-7958-4f4a-907e-7aee30b46649 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:55.978911 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93450daf-7958-4f4a-907e-7aee30b46649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:27:55.979308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93450daf-7958-4f4a-907e-7aee30b46649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:55.980947 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93450daf-7958-4f4a-907e-7aee30b46649 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:55.994314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1246/2514] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:27:55.999216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f82b6-f874-4438-9f19-982231b71422 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:56.010665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f82b6-f874-4438-9f19-982231b71422 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:56.015928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0707b-431e-453c-9142-3a0784508cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:56.016583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0707b-431e-453c-9142-3a0784508cca admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:56.016945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0707b-431e-453c-9142-3a0784508cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:56.017294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0707b-431e-453c-9142-3a0784508cca admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:56.018366 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0707b-431e-453c-9142-3a0784508cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:56.020375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0707b-431e-453c-9142-3a0784508cca admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:56.053550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1269/2515] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:27:55 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:27:56.054696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450daf-7958-4f4a-907e-7aee30b46649 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:56.065798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450daf-7958-4f4a-907e-7aee30b46649 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:56.131352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d448b-2981-4696-8e28-27a3f4351367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:56.131996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d448b-2981-4696-8e28-27a3f4351367 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:56.132340 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d448b-2981-4696-8e28-27a3f4351367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:56.132689 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d448b-2981-4696-8e28-27a3f4351367 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:56.133440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d448b-2981-4696-8e28-27a3f4351367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:56.135681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d448b-2981-4696-8e28-27a3f4351367 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:56.168595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1247/2516] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:27:56 2022] POST /identity/v3/users => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:27:56.172940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0707b-431e-453c-9142-3a0784508cca admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:56.189304 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0707b-431e-453c-9142-3a0784508cca admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:56.199779 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03f00-9e52-4d66-8c57-364fa8429769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:56.200603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03f00-9e52-4d66-8c57-364fa8429769 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:56.200886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03f00-9e52-4d66-8c57-364fa8429769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:56.201175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03f00-9e52-4d66-8c57-364fa8429769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:56.201863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03f00-9e52-4d66-8c57-364fa8429769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:56.203681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03f00-9e52-4d66-8c57-364fa8429769 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:56.215825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1270/2517] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:27:56.221227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d448b-2981-4696-8e28-27a3f4351367 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:56.237359 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d448b-2981-4696-8e28-27a3f4351367 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:56.243297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8c05f-6bd3-42f5-b821-c197d5815c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:56.243944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8c05f-6bd3-42f5-b821-c197d5815c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:56.244223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8c05f-6bd3-42f5-b821-c197d5815c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:56.244635 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8c05f-6bd3-42f5-b821-c197d5815c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:56.245298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8c05f-6bd3-42f5-b821-c197d5815c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:56.246899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8c05f-6bd3-42f5-b821-c197d5815c3d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:56.262887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1248/2518] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:27:56.264206 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03f00-9e52-4d66-8c57-364fa8429769 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:56.277116 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03f00-9e52-4d66-8c57-364fa8429769 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:56.282265 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcff416-faff-496a-b107-6c836e87b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:56.283143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcff416-faff-496a-b107-6c836e87b0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:56.283467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcff416-faff-496a-b107-6c836e87b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:56.283739 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcff416-faff-496a-b107-6c836e87b0a3 admin admin] PATH_INFO: `/v3/projects/6024dd97263448f69b8ac958958dd8df/users/1f27da528cc346d19c3b2ccabe51bf1d/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:56.302215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcff416-faff-496a-b107-6c836e87b0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6024dd97263448f69b8ac958958dd8df, user_id=1f27da528cc346d19c3b2ccabe51bf1d, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:56.305067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcff416-faff-496a-b107-6c836e87b0a3 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:56.325083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1271/2519] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:27:56 2022] PUT /identity/v3/projects/6024dd97263448f69b8ac958958dd8df/users/1f27da528cc346d19c3b2ccabe51bf1d/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:27:56.330522 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aea954-f40c-4632-9832-8a80f32539d3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:56.330798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aea954-f40c-4632-9832-8a80f32539d3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:56.331117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aea954-f40c-4632-9832-8a80f32539d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:56.371275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a1aea954-f40c-4632-9832-8a80f32539d3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:27:56.371275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a1aea954-f40c-4632-9832-8a80f32539d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:56.445378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1249/2520] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:27:56.456292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcff416-faff-496a-b107-6c836e87b0a3 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:56.458113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-fdcff416-faff-496a-b107-6c836e87b0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:56.542043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcff416-faff-496a-b107-6c836e87b0a3 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:56.546033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5840ff-7846-431d-9f35-e0daa6aa341b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:56.546733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5840ff-7846-431d-9f35-e0daa6aa341b service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:56.547011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5840ff-7846-431d-9f35-e0daa6aa341b service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:56.547321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5840ff-7846-431d-9f35-e0daa6aa341b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:56.557467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5840ff-7846-431d-9f35-e0daa6aa341b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:56.559103 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5840ff-7846-431d-9f35-e0daa6aa341b service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:56.570286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1272/2521] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:27:57.312832 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c24d00-20ef-40e5-8d52-281ab906e17f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:57.313907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c24d00-20ef-40e5-8d52-281ab906e17f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:57.314414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c24d00-20ef-40e5-8d52-281ab906e17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:57.381987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-10c24d00-20ef-40e5-8d52-281ab906e17f None None] MFA Rules not processed for user `1f27da528cc346d19c3b2ccabe51bf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:27:57.383330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-10c24d00-20ef-40e5-8d52-281ab906e17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:57.396600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:57.537986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5840ff-7846-431d-9f35-e0daa6aa341b service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:57.539524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1250/2522] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:27:57.561002 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5840ff-7846-431d-9f35-e0daa6aa341b service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:57.596006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e843caa-9cbf-4208-bb44-484ef697d10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:57.596938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e843caa-9cbf-4208-bb44-484ef697d10c admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:57.597458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e843caa-9cbf-4208-bb44-484ef697d10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:57.597893 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e843caa-9cbf-4208-bb44-484ef697d10c admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:57.598907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e843caa-9cbf-4208-bb44-484ef697d10c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:57.605612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e843caa-9cbf-4208-bb44-484ef697d10c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:57.706844 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1273/2523] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:27:57 2022] POST /identity/v3/projects => generated 405 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:27:57.708468 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c24d00-20ef-40e5-8d52-281ab906e17f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:57.725357 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c24d00-20ef-40e5-8d52-281ab906e17f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:57.808227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf07a2-74df-41b3-8921-beb35d2f610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:57.808862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf07a2-74df-41b3-8921-beb35d2f610f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:57.809146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf07a2-74df-41b3-8921-beb35d2f610f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:57.809414 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf07a2-74df-41b3-8921-beb35d2f610f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:57.810155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf07a2-74df-41b3-8921-beb35d2f610f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:57.812769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf07a2-74df-41b3-8921-beb35d2f610f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:57.845810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1251/2524] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:27:57 2022] POST /identity/v3/users => generated 309 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:27:57.849515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e843caa-9cbf-4208-bb44-484ef697d10c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:57.860446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e843caa-9cbf-4208-bb44-484ef697d10c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:57.865023 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60a021-6bda-40fd-8e24-db7664a59519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:57.865630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60a021-6bda-40fd-8e24-db7664a59519 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:57.865903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60a021-6bda-40fd-8e24-db7664a59519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:57.866168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60a021-6bda-40fd-8e24-db7664a59519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:57.866807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60a021-6bda-40fd-8e24-db7664a59519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:57.868446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60a021-6bda-40fd-8e24-db7664a59519 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:57.883416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1274/2525] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:27:57.884699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf07a2-74df-41b3-8921-beb35d2f610f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:57.895676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf07a2-74df-41b3-8921-beb35d2f610f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:57.900908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71d9f7-e6cd-4a27-bf33-b2d9e3567ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:57.901860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71d9f7-e6cd-4a27-bf33-b2d9e3567ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:57.902386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71d9f7-e6cd-4a27-bf33-b2d9e3567ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:57.902882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71d9f7-e6cd-4a27-bf33-b2d9e3567ff8 admin admin] PATH_INFO: `/v3/projects/99691c1b937f4a4fb7ee00d3688dd230/users/1b508548c1114de59748a6b26c38faa8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:57.926375 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71d9f7-e6cd-4a27-bf33-b2d9e3567ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99691c1b937f4a4fb7ee00d3688dd230, user_id=1b508548c1114de59748a6b26c38faa8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:57.929152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71d9f7-e6cd-4a27-bf33-b2d9e3567ff8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:57.946970 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1252/2526] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:27:57 2022] PUT /identity/v3/projects/99691c1b937f4a4fb7ee00d3688dd230/users/1b508548c1114de59748a6b26c38faa8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:27:57.952095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60a021-6bda-40fd-8e24-db7664a59519 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:57.966033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60a021-6bda-40fd-8e24-db7664a59519 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:57.971634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:58.044448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bd470-9865-4bb7-8863-7c7142c43346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:58.045196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bd470-9865-4bb7-8863-7c7142c43346 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:58.045586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bd470-9865-4bb7-8863-7c7142c43346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:58.045919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bd470-9865-4bb7-8863-7c7142c43346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:58.046630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bd470-9865-4bb7-8863-7c7142c43346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:58.048599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bd470-9865-4bb7-8863-7c7142c43346 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:58.059236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1275/2527] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:27:58.063941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71d9f7-e6cd-4a27-bf33-b2d9e3567ff8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:27:58.074610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71d9f7-e6cd-4a27-bf33-b2d9e3567ff8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:27:58.079186 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7944a-58a7-450a-9e02-740eb9dbf9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:27:58.079907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7944a-58a7-450a-9e02-740eb9dbf9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:58.080181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7944a-58a7-450a-9e02-740eb9dbf9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:58.080643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7944a-58a7-450a-9e02-740eb9dbf9c2 admin admin] PATH_INFO: `/v3/projects/99691c1b937f4a4fb7ee00d3688dd230/users/1b508548c1114de59748a6b26c38faa8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:58.082559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7944a-58a7-450a-9e02-740eb9dbf9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99691c1b937f4a4fb7ee00d3688dd230, user_id=1b508548c1114de59748a6b26c38faa8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:27:58.085218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7944a-58a7-450a-9e02-740eb9dbf9c2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:27:58.102243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1253/2528] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:27:58 2022] PUT /identity/v3/projects/99691c1b937f4a4fb7ee00d3688dd230/users/1b508548c1114de59748a6b26c38faa8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:27:58.936595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd4db-cd9e-4232-808a-7252e5f577c8 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:27:58.937188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd4db-cd9e-4232-808a-7252e5f577c8 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:27:58.937188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd4db-cd9e-4232-808a-7252e5f577c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:27:58.983601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-bcddd4db-cd9e-4232-808a-7252e5f577c8 None None] MFA Rules not processed for user `1b508548c1114de59748a6b26c38faa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:27:58.986013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bcddd4db-cd9e-4232-808a-7252e5f577c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:27:59.113918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1276/2529] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:00.484935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7944a-58a7-450a-9e02-740eb9dbf9c2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:00.559566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7944a-58a7-450a-9e02-740eb9dbf9c2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:00.564955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:00.565591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:00.565869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:00.566166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] PATH_INFO: `/v3/users/1f27da528cc346d19c3b2ccabe51bf1d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:00.567348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f27da528cc346d19c3b2ccabe51bf1d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:00.569274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:00.570748 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:00.619602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f27da528cc346d19c3b2ccabe51bf1d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:00.631905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f27da528cc346d19c3b2ccabe51bf1d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:00.638715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f27da528cc346d19c3b2ccabe51bf1d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:00.639422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f27da528cc346d19c3b2ccabe51bf1d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:00.640026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f27da528cc346d19c3b2ccabe51bf1d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:00.654396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1254/2530] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:00 2022] DELETE /identity/v3/users/1f27da528cc346d19c3b2ccabe51bf1d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:00.834314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddd4db-cd9e-4232-808a-7252e5f577c8 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:00.846282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddd4db-cd9e-4232-808a-7252e5f577c8 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:00.915756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:00.916388 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:00.916643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:00.916902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] PATH_INFO: `/v3/projects/6024dd97263448f69b8ac958958dd8df` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:00.918020 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6024dd97263448f69b8ac958958dd8df)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:00.919993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:00.956517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:00.971794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6024dd97263448f69b8ac958958dd8df', 'request_id': 'req-dc3b3273-159a-4c0c-8402-e008ae2084f7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:00.980560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6024dd97263448f69b8ac958958dd8df', 'request_id': 'req-dc3b3273-159a-4c0c-8402-e008ae2084f7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:00.987648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6024dd97263448f69b8ac958958dd8df', 'request_id': 'req-dc3b3273-159a-4c0c-8402-e008ae2084f7'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.000694 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] The token cache is being invalidate because project 6024dd97263448f69b8ac958958dd8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:01.001013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.001730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.003412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1277/2531] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:00 2022] DELETE /identity/v3/projects/6024dd97263448f69b8ac958958dd8df => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:01.008815 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:01.010242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:01.024168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07097d8-6a40-4cb6-80b6-79fb160789cd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:01.083851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:01.084488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.084763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.085031 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] PATH_INFO: `/v3/users/1b508548c1114de59748a6b26c38faa8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:01.086144 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b508548c1114de59748a6b26c38faa8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:01.088167 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:01.140855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b508548c1114de59748a6b26c38faa8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.155740 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b508548c1114de59748a6b26c38faa8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.163591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b508548c1114de59748a6b26c38faa8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.164288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b508548c1114de59748a6b26c38faa8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.164903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cb8b100-a79b-4bad-8043-7605da54857f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b508548c1114de59748a6b26c38faa8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.174559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:01.180286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1255/2532] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:01 2022] DELETE /identity/v3/users/1b508548c1114de59748a6b26c38faa8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:01.357760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:01.359887 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:01.375390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b3273-159a-4c0c-8402-e008ae2084f7 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:01.434330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:01.434974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.435273 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.435551 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] PATH_INFO: `/v3/projects/99691c1b937f4a4fb7ee00d3688dd230` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:01.436691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99691c1b937f4a4fb7ee00d3688dd230)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:01.438728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:01.487829 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99691c1b937f4a4fb7ee00d3688dd230', 'request_id': 'req-cf13f327-a6f3-43db-8eca-790bf074afd8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.498370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99691c1b937f4a4fb7ee00d3688dd230', 'request_id': 'req-cf13f327-a6f3-43db-8eca-790bf074afd8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.505098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99691c1b937f4a4fb7ee00d3688dd230', 'request_id': 'req-cf13f327-a6f3-43db-8eca-790bf074afd8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.515387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] The token cache is being invalidate because project 99691c1b937f4a4fb7ee00d3688dd230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:01.515680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.516294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cf13f327-a6f3-43db-8eca-790bf074afd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:01.518066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1278/2533] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:01 2022] DELETE /identity/v3/projects/99691c1b937f4a4fb7ee00d3688dd230 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:01.523129 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabdd5d-3edc-4b8f-a38c-2e143a029a9a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.523671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabdd5d-3edc-4b8f-a38c-2e143a029a9a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.523771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabdd5d-3edc-4b8f-a38c-2e143a029a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:01.543784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4fabdd5d-3edc-4b8f-a38c-2e143a029a9a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:01.544918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4fabdd5d-3edc-4b8f-a38c-2e143a029a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:01.609575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1256/2534] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:01.617772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6cd81-6b77-4935-9b59-7c860cdc74be None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.618310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6cd81-6b77-4935-9b59-7c860cdc74be None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.618628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6cd81-6b77-4935-9b59-7c860cdc74be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:01.639390 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-95c6cd81-6b77-4935-9b59-7c860cdc74be None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:01.640606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-95c6cd81-6b77-4935-9b59-7c860cdc74be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:01.649768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1279/2535] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:01.654600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabdd5d-3edc-4b8f-a38c-2e143a029a9a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:01.665099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabdd5d-3edc-4b8f-a38c-2e143a029a9a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:01.670305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32893-8b7f-4b8d-af4f-6aeed2372185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:01.670943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32893-8b7f-4b8d-af4f-6aeed2372185 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.671219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32893-8b7f-4b8d-af4f-6aeed2372185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.671521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32893-8b7f-4b8d-af4f-6aeed2372185 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:01.672174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c32893-8b7f-4b8d-af4f-6aeed2372185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:28:01.672476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c32893-8b7f-4b8d-af4f-6aeed2372185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:01.674676 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c32893-8b7f-4b8d-af4f-6aeed2372185 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:01.687959 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1257/2536] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:28:01.693080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6cd81-6b77-4935-9b59-7c860cdc74be None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:01.702596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6cd81-6b77-4935-9b59-7c860cdc74be None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:01.708154 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e5ef-ce9e-4906-8c70-d0418f9314dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:01.708742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e5ef-ce9e-4906-8c70-d0418f9314dc admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.709045 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e5ef-ce9e-4906-8c70-d0418f9314dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.709310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e5ef-ce9e-4906-8c70-d0418f9314dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:01.709938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1e5ef-ce9e-4906-8c70-d0418f9314dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:01.711857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1e5ef-ce9e-4906-8c70-d0418f9314dc admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:01.742907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1280/2537] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:01 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:01.747103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32893-8b7f-4b8d-af4f-6aeed2372185 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:01.758502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32893-8b7f-4b8d-af4f-6aeed2372185 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:01.816464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555851a-7e9c-4890-8210-dc4bc46e4dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:01.816997 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555851a-7e9c-4890-8210-dc4bc46e4dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.817275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555851a-7e9c-4890-8210-dc4bc46e4dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.817547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555851a-7e9c-4890-8210-dc4bc46e4dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:01.818180 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555851a-7e9c-4890-8210-dc4bc46e4dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:01.820168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555851a-7e9c-4890-8210-dc4bc46e4dd2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:01.843668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1258/2538] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:01 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:01.848279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e5ef-ce9e-4906-8c70-d0418f9314dc admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:01.858764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e5ef-ce9e-4906-8c70-d0418f9314dc admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:01.864194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3400-acca-4f78-8610-474bfa724577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:01.864876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3400-acca-4f78-8610-474bfa724577 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.865152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3400-acca-4f78-8610-474bfa724577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.865422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3400-acca-4f78-8610-474bfa724577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:01.866063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee3400-acca-4f78-8610-474bfa724577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:01.867730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee3400-acca-4f78-8610-474bfa724577 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:01.878435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1281/2539] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:01.882801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555851a-7e9c-4890-8210-dc4bc46e4dd2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:01.893209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555851a-7e9c-4890-8210-dc4bc46e4dd2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:01.898029 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d90c7-4e3d-4034-854e-8720dac339db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:01.898776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d90c7-4e3d-4034-854e-8720dac339db admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.899169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d90c7-4e3d-4034-854e-8720dac339db admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.899474 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d90c7-4e3d-4034-854e-8720dac339db admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:01.900123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d90c7-4e3d-4034-854e-8720dac339db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:01.901695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d90c7-4e3d-4034-854e-8720dac339db admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:01.914763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1259/2540] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:01.917375 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3400-acca-4f78-8610-474bfa724577 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:01.929934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3400-acca-4f78-8610-474bfa724577 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:01.936198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0d543-8a54-4592-8021-7cbeda3f6429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:01.936924 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d543-8a54-4592-8021-7cbeda3f6429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.937119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d543-8a54-4592-8021-7cbeda3f6429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.937392 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d543-8a54-4592-8021-7cbeda3f6429 admin admin] PATH_INFO: `/v3/projects/af4cdc7c2b4e48ebbdf7b696b7b1ea25/users/1e5737b2fafc49eeabdf0ab2cd6d5d18/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:01.941105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:01.960679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0d543-8a54-4592-8021-7cbeda3f6429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4cdc7c2b4e48ebbdf7b696b7b1ea25, user_id=1e5737b2fafc49eeabdf0ab2cd6d5d18, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:01.963362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0d543-8a54-4592-8021-7cbeda3f6429 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:01.982153 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1282/2541] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:01 2022] PUT /identity/v3/projects/af4cdc7c2b4e48ebbdf7b696b7b1ea25/users/1e5737b2fafc49eeabdf0ab2cd6d5d18/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:01.993889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59786f-3c4e-4161-923a-d4e3d482c8c2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:01.994218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59786f-3c4e-4161-923a-d4e3d482c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:01.994441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59786f-3c4e-4161-923a-d4e3d482c8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:02.022286 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cf59786f-3c4e-4161-923a-d4e3d482c8c2 None None] MFA Rules not processed for user `1e5737b2fafc49eeabdf0ab2cd6d5d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:02.023617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cf59786f-3c4e-4161-923a-d4e3d482c8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:02.079032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:02.091656 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1260/2542] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:02.096614 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0d543-8a54-4592-8021-7cbeda3f6429 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:02.165283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0d543-8a54-4592-8021-7cbeda3f6429 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:02.170046 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e763ed-de93-4bb0-afc7-e6e1ba120c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:02.170667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e763ed-de93-4bb0-afc7-e6e1ba120c6f admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:02.170946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e763ed-de93-4bb0-afc7-e6e1ba120c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:02.171219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e763ed-de93-4bb0-afc7-e6e1ba120c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:02.171929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e763ed-de93-4bb0-afc7-e6e1ba120c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:02.173880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e763ed-de93-4bb0-afc7-e6e1ba120c6f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:02.205085 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1283/2543] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:02 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:28:02.209295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59786f-3c4e-4161-923a-d4e3d482c8c2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:02.221583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59786f-3c4e-4161-923a-d4e3d482c8c2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:02.278426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39443a-e252-4b17-b5fd-0cbd1521a7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:02.279036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39443a-e252-4b17-b5fd-0cbd1521a7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:02.279344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39443a-e252-4b17-b5fd-0cbd1521a7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:02.279620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39443a-e252-4b17-b5fd-0cbd1521a7d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:02.280261 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39443a-e252-4b17-b5fd-0cbd1521a7d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:02.282284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39443a-e252-4b17-b5fd-0cbd1521a7d8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:02.307233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1261/2544] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:02 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:02.311109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e763ed-de93-4bb0-afc7-e6e1ba120c6f admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:02.322237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e763ed-de93-4bb0-afc7-e6e1ba120c6f admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:02.327549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104c135-b217-498e-8cb1-dce06979be80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:02.328144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c135-b217-498e-8cb1-dce06979be80 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:02.328445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c135-b217-498e-8cb1-dce06979be80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:02.328710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c135-b217-498e-8cb1-dce06979be80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:02.329557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104c135-b217-498e-8cb1-dce06979be80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:02.331156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104c135-b217-498e-8cb1-dce06979be80 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:02.342236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1284/2545] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:28:02.346921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39443a-e252-4b17-b5fd-0cbd1521a7d8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:02.357731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39443a-e252-4b17-b5fd-0cbd1521a7d8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:02.363421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e473cb8-e769-488f-8fb4-67639664f0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:02.364077 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473cb8-e769-488f-8fb4-67639664f0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:02.364342 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473cb8-e769-488f-8fb4-67639664f0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:02.364611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473cb8-e769-488f-8fb4-67639664f0e1 admin admin] PATH_INFO: `/v3/projects/bff49ef1e3eb4da4bc00b73b5b74f991/users/d9b4ee06f98d4e50901e8136a30c91ad/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:02.379650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e473cb8-e769-488f-8fb4-67639664f0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff49ef1e3eb4da4bc00b73b5b74f991, user_id=d9b4ee06f98d4e50901e8136a30c91ad, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:02.382283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e473cb8-e769-488f-8fb4-67639664f0e1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:02.397315 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1262/2546] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:02 2022] PUT /identity/v3/projects/bff49ef1e3eb4da4bc00b73b5b74f991/users/d9b4ee06f98d4e50901e8136a30c91ad/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:02.401297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104c135-b217-498e-8cb1-dce06979be80 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:02.411574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104c135-b217-498e-8cb1-dce06979be80 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:02.471233 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77552537-da1b-4469-bed9-80ddf93f9287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:02.471870 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77552537-da1b-4469-bed9-80ddf93f9287 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:02.472148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77552537-da1b-4469-bed9-80ddf93f9287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:02.472418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77552537-da1b-4469-bed9-80ddf93f9287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:02.473062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77552537-da1b-4469-bed9-80ddf93f9287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:02.474660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77552537-da1b-4469-bed9-80ddf93f9287 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:02.485051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1285/2547] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:02.489620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e473cb8-e769-488f-8fb4-67639664f0e1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:02.499932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e473cb8-e769-488f-8fb4-67639664f0e1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:02.504887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930be9-f583-4af9-bf89-73b3ef642602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:02.505545 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930be9-f583-4af9-bf89-73b3ef642602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:02.505818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930be9-f583-4af9-bf89-73b3ef642602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:02.506061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930be9-f583-4af9-bf89-73b3ef642602 admin admin] PATH_INFO: `/v3/projects/bff49ef1e3eb4da4bc00b73b5b74f991/users/d9b4ee06f98d4e50901e8136a30c91ad/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:02.508017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19930be9-f583-4af9-bf89-73b3ef642602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff49ef1e3eb4da4bc00b73b5b74f991, user_id=d9b4ee06f98d4e50901e8136a30c91ad, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:02.510632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19930be9-f583-4af9-bf89-73b3ef642602 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:02.521659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1263/2548] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:02 2022] PUT /identity/v3/projects/bff49ef1e3eb4da4bc00b73b5b74f991/users/d9b4ee06f98d4e50901e8136a30c91ad/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:02.531736 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c146-952a-4f88-ac29-0ec73434e876 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:02.532017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c146-952a-4f88-ac29-0ec73434e876 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:02.532414 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66c146-952a-4f88-ac29-0ec73434e876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:02.560944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6f66c146-952a-4f88-ac29-0ec73434e876 None None] MFA Rules not processed for user `d9b4ee06f98d4e50901e8136a30c91ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:02.562200 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6f66c146-952a-4f88-ac29-0ec73434e876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:02.615050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:02.639820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1286/2549] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:28:02.652331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930be9-f583-4af9-bf89-73b3ef642602 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:02.653616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-19930be9-f583-4af9-bf89-73b3ef642602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:02.717478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930be9-f583-4af9-bf89-73b3ef642602 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:02.722160 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b5fe-6dd9-4edd-866a-725d5b2195a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:02.722765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b5fe-6dd9-4edd-866a-725d5b2195a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:02.723041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b5fe-6dd9-4edd-866a-725d5b2195a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:02.723334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b5fe-6dd9-4edd-866a-725d5b2195a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:02.732797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25b5fe-6dd9-4edd-866a-725d5b2195a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:02.734250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25b5fe-6dd9-4edd-866a-725d5b2195a2 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:02.743885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1264/2550] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:02.823404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66c146-952a-4f88-ac29-0ec73434e876 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:02.834996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66c146-952a-4f88-ac29-0ec73434e876 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:02.838971 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9bd25-8396-41ab-9940-ec948adc6122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:02.839612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9bd25-8396-41ab-9940-ec948adc6122 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:02.839891 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9bd25-8396-41ab-9940-ec948adc6122 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:02.840148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9bd25-8396-41ab-9940-ec948adc6122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:02.898532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9bd25-8396-41ab-9940-ec948adc6122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:02.899995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9bd25-8396-41ab-9940-ec948adc6122 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:02.909403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1287/2551] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:06.671288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b5fe-6dd9-4edd-866a-725d5b2195a2 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:06.672877 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6e25b5fe-6dd9-4edd-866a-725d5b2195a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:06.727390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:06.754775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b5fe-6dd9-4edd-866a-725d5b2195a2 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:06.760465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c02dd-e32a-4860-a897-982852fc095c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:06.761098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c02dd-e32a-4860-a897-982852fc095c service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:06.761447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c02dd-e32a-4860-a897-982852fc095c service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:06.761726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c02dd-e32a-4860-a897-982852fc095c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:06.763537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f43c02dd-e32a-4860-a897-982852fc095c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:06.778348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c02dd-e32a-4860-a897-982852fc095c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:06.780021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c02dd-e32a-4860-a897-982852fc095c service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:06.791672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1265/2552] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:07.642525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc1c9-09b3-4cd5-b417-84c6e4f42b83 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:07.643016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc1c9-09b3-4cd5-b417-84c6e4f42b83 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:07.643126 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc1c9-09b3-4cd5-b417-84c6e4f42b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:07.663555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-c97fc1c9-09b3-4cd5-b417-84c6e4f42b83 None None] MFA Rules not processed for user `4c5af37aaa654585817e3aad0489d323`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:07.664769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c97fc1c9-09b3-4cd5-b417-84c6e4f42b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:07.721170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1288/2553] 10.222.0.39 () {58 vars in 967 bytes} [Sat Sep 3 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:07.733871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c02dd-e32a-4860-a897-982852fc095c service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:07.735410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f43c02dd-e32a-4860-a897-982852fc095c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:07.806050 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c02dd-e32a-4860-a897-982852fc095c service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:07.811045 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f09d0b-e60f-4a07-83b7-148d27c3c832 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a844df7e3574911b6ea31e7d7bee715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:07.811697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f09d0b-e60f-4a07-83b7-148d27c3c832 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:07.811980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f09d0b-e60f-4a07-83b7-148d27c3c832 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:07.812251 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f09d0b-e60f-4a07-83b7-148d27c3c832 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:07.820979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f09d0b-e60f-4a07-83b7-148d27c3c832 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:07.822604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f09d0b-e60f-4a07-83b7-148d27c3c832 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:07.830877 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1266/2554] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Sep 3 01:28:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 01:28:09.971618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc1c9-09b3-4cd5-b417-84c6e4f42b83 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:10.040716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc1c9-09b3-4cd5-b417-84c6e4f42b83 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:10.045473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:10.046099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:10.046377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:10.046646 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] PATH_INFO: `/v3/users/1e5737b2fafc49eeabdf0ab2cd6d5d18` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:10.047850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5737b2fafc49eeabdf0ab2cd6d5d18)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:10.049885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:10.078666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:10.097775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5737b2fafc49eeabdf0ab2cd6d5d18'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.110619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5737b2fafc49eeabdf0ab2cd6d5d18'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.117670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5737b2fafc49eeabdf0ab2cd6d5d18'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.118381 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5737b2fafc49eeabdf0ab2cd6d5d18'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.118994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5737b2fafc49eeabdf0ab2cd6d5d18'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.132851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1289/2555] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:09 2022] DELETE /identity/v3/users/1e5737b2fafc49eeabdf0ab2cd6d5d18 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:10.137583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3510c-f631-482e-800b-5543a13c380a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:10.138064 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3510c-f631-482e-800b-5543a13c380a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:10.138160 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3510c-f631-482e-800b-5543a13c380a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:10.156862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d4c3510c-f631-482e-800b-5543a13c380a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:10.158076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d4c3510c-f631-482e-800b-5543a13c380a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:10.229670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1267/2556] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:10.239714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:10.241435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:10.299214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a86bf3-c2c2-41c7-b51c-eda5d82025e0 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:10.303444 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca1b8c-ad3b-4a6c-92f5-ee448b34d73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:10.303993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca1b8c-ad3b-4a6c-92f5-ee448b34d73b service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:10.304259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca1b8c-ad3b-4a6c-92f5-ee448b34d73b service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:10.304527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca1b8c-ad3b-4a6c-92f5-ee448b34d73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:10.315221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca1b8c-ad3b-4a6c-92f5-ee448b34d73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:10.316757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca1b8c-ad3b-4a6c-92f5-ee448b34d73b service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:10.326348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1290/2557] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:10.610570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3510c-f631-482e-800b-5543a13c380a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:10.612061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d4c3510c-f631-482e-800b-5543a13c380a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:10.627521 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3510c-f631-482e-800b-5543a13c380a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:10.632910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:10.633827 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:10.634238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:10.634501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] PATH_INFO: `/v3/projects/af4cdc7c2b4e48ebbdf7b696b7b1ea25` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:10.635862 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4cdc7c2b4e48ebbdf7b696b7b1ea25)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:10.637747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:10.687233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4cdc7c2b4e48ebbdf7b696b7b1ea25', 'request_id': 'req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.695384 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4cdc7c2b4e48ebbdf7b696b7b1ea25', 'request_id': 'req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.697399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:10.702751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4cdc7c2b4e48ebbdf7b696b7b1ea25', 'request_id': 'req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.714670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] The token cache is being invalidate because project af4cdc7c2b4e48ebbdf7b696b7b1ea25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:10.714957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.715702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.717349 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1268/2558] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:10 2022] DELETE /identity/v3/projects/af4cdc7c2b4e48ebbdf7b696b7b1ea25 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:10.722471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca1b8c-ad3b-4a6c-92f5-ee448b34d73b service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:10.737413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca1b8c-ad3b-4a6c-92f5-ee448b34d73b service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:10.801073 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:10.801701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:10.802008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:10.802283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] PATH_INFO: `/v3/users/d9b4ee06f98d4e50901e8136a30c91ad` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:10.803469 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b4ee06f98d4e50901e8136a30c91ad)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:10.805417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:10.851519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b4ee06f98d4e50901e8136a30c91ad'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.852607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:10.865340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b4ee06f98d4e50901e8136a30c91ad'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.872192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b4ee06f98d4e50901e8136a30c91ad'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.872867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b4ee06f98d4e50901e8136a30c91ad'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.873473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-7b78fc6f-e336-4a7c-a59d-e545ac640fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b4ee06f98d4e50901e8136a30c91ad'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:10.887515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1291/2559] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:10 2022] DELETE /identity/v3/users/d9b4ee06f98d4e50901e8136a30c91ad => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:11.182256 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:11.184070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:11.204625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c686a-d3f3-4eb1-be85-a8b4fa49283c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:11.264279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:11.264966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:11.265387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:11.265653 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] PATH_INFO: `/v3/projects/bff49ef1e3eb4da4bc00b73b5b74f991` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:11.266830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff49ef1e3eb4da4bc00b73b5b74f991)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:11.268775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:11.321419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff49ef1e3eb4da4bc00b73b5b74f991', 'request_id': 'req-e16bdf9c-8318-494c-a7bb-4d6e9137d021'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:11.334509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff49ef1e3eb4da4bc00b73b5b74f991', 'request_id': 'req-e16bdf9c-8318-494c-a7bb-4d6e9137d021'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:11.352350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff49ef1e3eb4da4bc00b73b5b74f991', 'request_id': 'req-e16bdf9c-8318-494c-a7bb-4d6e9137d021'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:11.364133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] The token cache is being invalidate because project bff49ef1e3eb4da4bc00b73b5b74f991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:11.364420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:11.365149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e16bdf9c-8318-494c-a7bb-4d6e9137d021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:11.366763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1269/2560] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:11 2022] DELETE /identity/v3/projects/bff49ef1e3eb4da4bc00b73b5b74f991 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:11.372664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b00d91-b8d0-44ba-9160-fde223da2341 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:11.373134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b00d91-b8d0-44ba-9160-fde223da2341 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:11.373225 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b00d91-b8d0-44ba-9160-fde223da2341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:11.396453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f5b00d91-b8d0-44ba-9160-fde223da2341 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:11.398039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f5b00d91-b8d0-44ba-9160-fde223da2341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:11.457484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1292/2561] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:11.465620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a9c49-23f5-4781-9bf2-40de2551e523 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:11.465906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a9c49-23f5-4781-9bf2-40de2551e523 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:11.466179 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a9c49-23f5-4781-9bf2-40de2551e523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:11.488221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-655a9c49-23f5-4781-9bf2-40de2551e523 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:11.489446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-655a9c49-23f5-4781-9bf2-40de2551e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:11.499115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1270/2562] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:11.505079 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b00d91-b8d0-44ba-9160-fde223da2341 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:11.516827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b00d91-b8d0-44ba-9160-fde223da2341 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:11.522848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b60cc-99c1-425a-8fd6-e83685509f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:11.523495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b60cc-99c1-425a-8fd6-e83685509f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:11.523768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b60cc-99c1-425a-8fd6-e83685509f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:11.524048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b60cc-99c1-425a-8fd6-e83685509f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:11.524702 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b60cc-99c1-425a-8fd6-e83685509f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:28:11.525007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b60cc-99c1-425a-8fd6-e83685509f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:11.526633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b60cc-99c1-425a-8fd6-e83685509f33 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:11.538450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1293/2563] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:28:11.542954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a9c49-23f5-4781-9bf2-40de2551e523 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:11.552561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a9c49-23f5-4781-9bf2-40de2551e523 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:11.557828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1470efa-0523-4d9b-bf23-45f9de0bc3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:11.558429 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1470efa-0523-4d9b-bf23-45f9de0bc3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:11.558704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1470efa-0523-4d9b-bf23-45f9de0bc3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:11.558977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1470efa-0523-4d9b-bf23-45f9de0bc3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:11.559657 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1470efa-0523-4d9b-bf23-45f9de0bc3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:11.561580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1470efa-0523-4d9b-bf23-45f9de0bc3b2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:11.592189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1271/2564] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:11 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:11.596912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b60cc-99c1-425a-8fd6-e83685509f33 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:11.607834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b60cc-99c1-425a-8fd6-e83685509f33 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:11.668577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e7c76-0f19-42ce-8879-17e1bc85b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:11.669092 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7c76-0f19-42ce-8879-17e1bc85b30b admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:11.669374 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7c76-0f19-42ce-8879-17e1bc85b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:11.669633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7c76-0f19-42ce-8879-17e1bc85b30b admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:11.670282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e7c76-0f19-42ce-8879-17e1bc85b30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:11.672275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e7c76-0f19-42ce-8879-17e1bc85b30b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:11.696300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1294/2565] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:11 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:11.700492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1470efa-0523-4d9b-bf23-45f9de0bc3b2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:11.711455 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1470efa-0523-4d9b-bf23-45f9de0bc3b2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:11.717250 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f14136-05e2-44be-91ef-3edfaa2f5b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:11.718201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f14136-05e2-44be-91ef-3edfaa2f5b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:11.718471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f14136-05e2-44be-91ef-3edfaa2f5b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:11.718731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f14136-05e2-44be-91ef-3edfaa2f5b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:11.719404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f14136-05e2-44be-91ef-3edfaa2f5b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:11.720994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f14136-05e2-44be-91ef-3edfaa2f5b6e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:11.731600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1272/2566] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:11.735803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e7c76-0f19-42ce-8879-17e1bc85b30b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:11.746804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e7c76-0f19-42ce-8879-17e1bc85b30b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:11.752752 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe93ee-604c-48c0-ac6e-fbca03528f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:11.753403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe93ee-604c-48c0-ac6e-fbca03528f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:11.753670 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe93ee-604c-48c0-ac6e-fbca03528f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:11.753940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe93ee-604c-48c0-ac6e-fbca03528f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:11.754586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe93ee-604c-48c0-ac6e-fbca03528f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:11.756406 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe93ee-604c-48c0-ac6e-fbca03528f34 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:11.767511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1295/2567] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:11.771972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f14136-05e2-44be-91ef-3edfaa2f5b6e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:11.782139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f14136-05e2-44be-91ef-3edfaa2f5b6e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:11.787071 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add9d7d-41ce-457b-b0ca-dc6518d8f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:11.787887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add9d7d-41ce-457b-b0ca-dc6518d8f9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:11.788162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add9d7d-41ce-457b-b0ca-dc6518d8f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:11.788430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add9d7d-41ce-457b-b0ca-dc6518d8f9d4 admin admin] PATH_INFO: `/v3/projects/19be4ca7e013438dace236dc79053636/users/62f81843c2c74ad2921a55828ada0480/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:11.802955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add9d7d-41ce-457b-b0ca-dc6518d8f9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19be4ca7e013438dace236dc79053636, user_id=62f81843c2c74ad2921a55828ada0480, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:11.805632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add9d7d-41ce-457b-b0ca-dc6518d8f9d4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:11.822310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1273/2568] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:11 2022] PUT /identity/v3/projects/19be4ca7e013438dace236dc79053636/users/62f81843c2c74ad2921a55828ada0480/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:11.833826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d329-f411-4182-b28a-43a754a3fd62 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:11.834151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d329-f411-4182-b28a-43a754a3fd62 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:11.834426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d329-f411-4182-b28a-43a754a3fd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:11.863629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-42d2d329-f411-4182-b28a-43a754a3fd62 None None] MFA Rules not processed for user `62f81843c2c74ad2921a55828ada0480`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:11.864842 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-42d2d329-f411-4182-b28a-43a754a3fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:11.885581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:11.936501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1296/2569] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:11.942680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add9d7d-41ce-457b-b0ca-dc6518d8f9d4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:11.956967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:12.016477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add9d7d-41ce-457b-b0ca-dc6518d8f9d4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:12.021609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ac568-020f-43d9-b17a-4ce61539371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:12.022251 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ac568-020f-43d9-b17a-4ce61539371c admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:12.022554 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ac568-020f-43d9-b17a-4ce61539371c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:12.022825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ac568-020f-43d9-b17a-4ce61539371c admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:12.023501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ac568-020f-43d9-b17a-4ce61539371c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:12.026812 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ac568-020f-43d9-b17a-4ce61539371c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:12.069119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1274/2570] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:11 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:12.070483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d329-f411-4182-b28a-43a754a3fd62 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:12.082230 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d329-f411-4182-b28a-43a754a3fd62 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:12.140123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e279931-de03-43ad-ad77-78183e59983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:12.140734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279931-de03-43ad-ad77-78183e59983e admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:12.141013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279931-de03-43ad-ad77-78183e59983e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:12.141285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e279931-de03-43ad-ad77-78183e59983e admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:12.141969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e279931-de03-43ad-ad77-78183e59983e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:12.143905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e279931-de03-43ad-ad77-78183e59983e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:12.169347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1297/2571] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:12 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:12.173497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ac568-020f-43d9-b17a-4ce61539371c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:12.186161 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ac568-020f-43d9-b17a-4ce61539371c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:12.192441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb269ae-ed24-4d7d-90f2-71ff877e80b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:12.192986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb269ae-ed24-4d7d-90f2-71ff877e80b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:12.193467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb269ae-ed24-4d7d-90f2-71ff877e80b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:12.193753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb269ae-ed24-4d7d-90f2-71ff877e80b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:12.194543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb269ae-ed24-4d7d-90f2-71ff877e80b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:12.196309 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb269ae-ed24-4d7d-90f2-71ff877e80b6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:12.211365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1275/2572] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:12.213105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e279931-de03-43ad-ad77-78183e59983e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:12.223618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e279931-de03-43ad-ad77-78183e59983e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:12.230692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e3220-247c-4a58-89a0-862780b624c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:12.231404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e3220-247c-4a58-89a0-862780b624c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:12.231682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e3220-247c-4a58-89a0-862780b624c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:12.231951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e3220-247c-4a58-89a0-862780b624c8 admin admin] PATH_INFO: `/v3/projects/20f69334c96b47b7ad4564da9f1a2d8d/users/380a635f9b9547dda09dd4773541f7c2/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:12.248450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e3220-247c-4a58-89a0-862780b624c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f69334c96b47b7ad4564da9f1a2d8d, user_id=380a635f9b9547dda09dd4773541f7c2, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:12.251095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e3220-247c-4a58-89a0-862780b624c8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:12.265667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1298/2573] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:12 2022] PUT /identity/v3/projects/20f69334c96b47b7ad4564da9f1a2d8d/users/380a635f9b9547dda09dd4773541f7c2/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:12.269715 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb269ae-ed24-4d7d-90f2-71ff877e80b6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:12.280673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb269ae-ed24-4d7d-90f2-71ff877e80b6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:12.341117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2060b46-2cc9-4ee5-81be-235bf316954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:12.341853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060b46-2cc9-4ee5-81be-235bf316954d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:12.342195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060b46-2cc9-4ee5-81be-235bf316954d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:12.342884 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060b46-2cc9-4ee5-81be-235bf316954d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:12.343641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2060b46-2cc9-4ee5-81be-235bf316954d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:12.345322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2060b46-2cc9-4ee5-81be-235bf316954d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:12.356327 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1276/2574] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:12.360594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e3220-247c-4a58-89a0-862780b624c8 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:12.371486 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e3220-247c-4a58-89a0-862780b624c8 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:12.376151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684421ec-c763-4fdc-b274-95e9bc617ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:12.376807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684421ec-c763-4fdc-b274-95e9bc617ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:12.377074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684421ec-c763-4fdc-b274-95e9bc617ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:12.377378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684421ec-c763-4fdc-b274-95e9bc617ecb admin admin] PATH_INFO: `/v3/projects/20f69334c96b47b7ad4564da9f1a2d8d/users/380a635f9b9547dda09dd4773541f7c2/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:12.379295 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684421ec-c763-4fdc-b274-95e9bc617ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f69334c96b47b7ad4564da9f1a2d8d, user_id=380a635f9b9547dda09dd4773541f7c2, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:12.382414 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684421ec-c763-4fdc-b274-95e9bc617ecb admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:12.392865 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1299/2575] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:12 2022] PUT /identity/v3/projects/20f69334c96b47b7ad4564da9f1a2d8d/users/380a635f9b9547dda09dd4773541f7c2/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:12.410406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2b72-237e-49e0-b905-adf41b01ee3d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:12.410750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2b72-237e-49e0-b905-adf41b01ee3d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:12.411034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2b72-237e-49e0-b905-adf41b01ee3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:12.447594 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4b9e2b72-237e-49e0-b905-adf41b01ee3d None None] MFA Rules not processed for user `380a635f9b9547dda09dd4773541f7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:12.448735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4b9e2b72-237e-49e0-b905-adf41b01ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:12.523957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1277/2576] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:12.535583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684421ec-c763-4fdc-b274-95e9bc617ecb admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:12.537617 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-684421ec-c763-4fdc-b274-95e9bc617ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:12.598866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684421ec-c763-4fdc-b274-95e9bc617ecb admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:12.603192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d29929-1cca-475e-baf4-3d64403b5ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:12.603818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d29929-1cca-475e-baf4-3d64403b5ddc service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:12.604064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d29929-1cca-475e-baf4-3d64403b5ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:12.604363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d29929-1cca-475e-baf4-3d64403b5ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:12.613863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d29929-1cca-475e-baf4-3d64403b5ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:12.615386 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d29929-1cca-475e-baf4-3d64403b5ddc service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:12.625605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1300/2577] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:13.061670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e2b72-237e-49e0-b905-adf41b01ee3d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:13.072997 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:13.144470 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e2b72-237e-49e0-b905-adf41b01ee3d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:13.153488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:13.154422 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:13.154771 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:13.155054 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] PATH_INFO: `/v3/users/62f81843c2c74ad2921a55828ada0480` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:13.156809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f81843c2c74ad2921a55828ada0480)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:13.159773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:13.211432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f81843c2c74ad2921a55828ada0480'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.223674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f81843c2c74ad2921a55828ada0480'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.230905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f81843c2c74ad2921a55828ada0480'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.231662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f81843c2c74ad2921a55828ada0480'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.232326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f81843c2c74ad2921a55828ada0480'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.251519 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1278/2578] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:13 2022] DELETE /identity/v3/users/62f81843c2c74ad2921a55828ada0480 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:13.256380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe9f6-ba49-4243-a3d4-1cd9e4eaea8b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:13.256657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe9f6-ba49-4243-a3d4-1cd9e4eaea8b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:13.256931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe9f6-ba49-4243-a3d4-1cd9e4eaea8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:13.278417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-ba9fe9f6-ba49-4243-a3d4-1cd9e4eaea8b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:13.279661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ba9fe9f6-ba49-4243-a3d4-1cd9e4eaea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:13.289648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:13.341143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1301/2579] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:13.351672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:13.353491 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:13.425167 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fc2d9-a559-4167-a73b-caab8bb9081e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:13.429959 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d235e0f-4f67-4d7c-b8bf-e43ca1cac6f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:13.430579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d235e0f-4f67-4d7c-b8bf-e43ca1cac6f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:13.430826 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d235e0f-4f67-4d7c-b8bf-e43ca1cac6f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:13.431147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d235e0f-4f67-4d7c-b8bf-e43ca1cac6f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:13.441265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d235e0f-4f67-4d7c-b8bf-e43ca1cac6f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:13.443218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d235e0f-4f67-4d7c-b8bf-e43ca1cac6f8 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:13.454239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1279/2580] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:13.733025 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fe9f6-ba49-4243-a3d4-1cd9e4eaea8b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:13.734644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-ba9fe9f6-ba49-4243-a3d4-1cd9e4eaea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:13.747749 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fe9f6-ba49-4243-a3d4-1cd9e4eaea8b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:13.753008 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:13.753718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:13.754065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:13.754404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] PATH_INFO: `/v3/projects/19be4ca7e013438dace236dc79053636` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:13.755664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19be4ca7e013438dace236dc79053636)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:13.757838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:13.806224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19be4ca7e013438dace236dc79053636', 'request_id': 'req-3b853b6d-daeb-41d0-b86c-274de6b05538'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.815975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19be4ca7e013438dace236dc79053636', 'request_id': 'req-3b853b6d-daeb-41d0-b86c-274de6b05538'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.822130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19be4ca7e013438dace236dc79053636', 'request_id': 'req-3b853b6d-daeb-41d0-b86c-274de6b05538'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.832666 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] The token cache is being invalidate because project 19be4ca7e013438dace236dc79053636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:13.832979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.833628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.835224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1302/2581] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:13 2022] DELETE /identity/v3/projects/19be4ca7e013438dace236dc79053636 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:13.839319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d235e0f-4f67-4d7c-b8bf-e43ca1cac6f8 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:13.849602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d235e0f-4f67-4d7c-b8bf-e43ca1cac6f8 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:13.879759 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:13.913809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:13.914476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:13.914750 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:13.915018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] PATH_INFO: `/v3/users/380a635f9b9547dda09dd4773541f7c2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:13.916227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=380a635f9b9547dda09dd4773541f7c2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:13.918151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:13.972444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '380a635f9b9547dda09dd4773541f7c2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.986120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '380a635f9b9547dda09dd4773541f7c2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.993447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '380a635f9b9547dda09dd4773541f7c2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.994132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '380a635f9b9547dda09dd4773541f7c2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:13.994745 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-47d01348-1865-44ed-ad67-1c015dc7f176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '380a635f9b9547dda09dd4773541f7c2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:14.010602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1280/2582] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:13 2022] DELETE /identity/v3/users/380a635f9b9547dda09dd4773541f7c2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:14.304154 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:14.305601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:14.319658 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b853b6d-daeb-41d0-b86c-274de6b05538 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:14.378585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:14.379224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:14.379531 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:14.379925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] PATH_INFO: `/v3/projects/20f69334c96b47b7ad4564da9f1a2d8d` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:14.381049 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f69334c96b47b7ad4564da9f1a2d8d)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:14.383290 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:14.425377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:14.435277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f69334c96b47b7ad4564da9f1a2d8d', 'request_id': 'req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:14.444885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f69334c96b47b7ad4564da9f1a2d8d', 'request_id': 'req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:14.451236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f69334c96b47b7ad4564da9f1a2d8d', 'request_id': 'req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:14.462026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] The token cache is being invalidate because project 20f69334c96b47b7ad4564da9f1a2d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:14.462314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:14.462969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-3e4880b6-08a2-4a88-8f7c-5d91cd05fc48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:14.464506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1303/2583] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:14 2022] DELETE /identity/v3/projects/20f69334c96b47b7ad4564da9f1a2d8d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:14.469869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9555-89fa-47e5-b9af-52380ee7c0ba None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:14.470347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9555-89fa-47e5-b9af-52380ee7c0ba None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:14.470494 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9555-89fa-47e5-b9af-52380ee7c0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:14.491015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-57bd9555-89fa-47e5-b9af-52380ee7c0ba None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:14.492621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-57bd9555-89fa-47e5-b9af-52380ee7c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:14.556070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1281/2584] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:14.565091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca40b0-f2f2-468f-bf34-4a266a83dca2 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:14.565407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca40b0-f2f2-468f-bf34-4a266a83dca2 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:14.565682 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca40b0-f2f2-468f-bf34-4a266a83dca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:14.589270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-bdca40b0-f2f2-468f-bf34-4a266a83dca2 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:14.590506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bdca40b0-f2f2-468f-bf34-4a266a83dca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:14.601297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1304/2585] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:14.605271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9555-89fa-47e5-b9af-52380ee7c0ba None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:14.615311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9555-89fa-47e5-b9af-52380ee7c0ba None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:14.620347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ada8f9-dc57-4f86-89fd-f3636c49f9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:14.620963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ada8f9-dc57-4f86-89fd-f3636c49f9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:14.621241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ada8f9-dc57-4f86-89fd-f3636c49f9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:14.621646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ada8f9-dc57-4f86-89fd-f3636c49f9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:14.622302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ada8f9-dc57-4f86-89fd-f3636c49f9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:28:14.622609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ada8f9-dc57-4f86-89fd-f3636c49f9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:14.624248 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ada8f9-dc57-4f86-89fd-f3636c49f9d3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:14.639295 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1282/2586] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:28:14.642940 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca40b0-f2f2-468f-bf34-4a266a83dca2 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:14.652761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca40b0-f2f2-468f-bf34-4a266a83dca2 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:14.657761 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b5b5d-416c-4bb9-aac2-64d8ec1a5375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:14.658459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b5b5d-416c-4bb9-aac2-64d8ec1a5375 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:14.658806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b5b5d-416c-4bb9-aac2-64d8ec1a5375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:14.659144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b5b5d-416c-4bb9-aac2-64d8ec1a5375 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:14.659871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b5b5d-416c-4bb9-aac2-64d8ec1a5375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:14.662216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b5b5d-416c-4bb9-aac2-64d8ec1a5375 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:14.698096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1305/2587] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:14 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:14.702125 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ada8f9-dc57-4f86-89fd-f3636c49f9d3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:14.713092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ada8f9-dc57-4f86-89fd-f3636c49f9d3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:14.778476 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:14.812087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2013af0-da4d-4156-b7b3-34ad9b20fd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:14.812717 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2013af0-da4d-4156-b7b3-34ad9b20fd85 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:14.812998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2013af0-da4d-4156-b7b3-34ad9b20fd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:14.813264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2013af0-da4d-4156-b7b3-34ad9b20fd85 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:14.813919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2013af0-da4d-4156-b7b3-34ad9b20fd85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:14.816444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2013af0-da4d-4156-b7b3-34ad9b20fd85 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:14.848008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1283/2588] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:14 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:28:14.853041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b5b5d-416c-4bb9-aac2-64d8ec1a5375 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:14.868782 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b5b5d-416c-4bb9-aac2-64d8ec1a5375 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:14.874946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafffc9-3e28-4ef4-bf1f-2b8b51be2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:14.875710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafffc9-3e28-4ef4-bf1f-2b8b51be2a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:14.876088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafffc9-3e28-4ef4-bf1f-2b8b51be2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:14.876892 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafffc9-3e28-4ef4-bf1f-2b8b51be2a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:14.877180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafffc9-3e28-4ef4-bf1f-2b8b51be2a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:14.878868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafffc9-3e28-4ef4-bf1f-2b8b51be2a00 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:14.890461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1306/2589] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:14.894721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2013af0-da4d-4156-b7b3-34ad9b20fd85 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:14.906667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2013af0-da4d-4156-b7b3-34ad9b20fd85 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:14.914452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560dcc9-fdf0-45aa-ad4b-f1fbcb51bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:14.915304 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560dcc9-fdf0-45aa-ad4b-f1fbcb51bbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:14.916010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560dcc9-fdf0-45aa-ad4b-f1fbcb51bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:14.916917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560dcc9-fdf0-45aa-ad4b-f1fbcb51bbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:14.917699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560dcc9-fdf0-45aa-ad4b-f1fbcb51bbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:14.919746 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560dcc9-fdf0-45aa-ad4b-f1fbcb51bbf6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:14.931875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1284/2590] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:14.936209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafffc9-3e28-4ef4-bf1f-2b8b51be2a00 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:14.946978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafffc9-3e28-4ef4-bf1f-2b8b51be2a00 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:14.951702 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6a03f-6466-4e44-9583-bd7f9d7bb6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:14.952359 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6a03f-6466-4e44-9583-bd7f9d7bb6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:14.952638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6a03f-6466-4e44-9583-bd7f9d7bb6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:14.952937 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6a03f-6466-4e44-9583-bd7f9d7bb6d6 admin admin] PATH_INFO: `/v3/projects/f6b754a79158403cb50ee711c401ff33/users/54b47cf3212a4d18bf3b11b8e67697eb/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:14.968941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6a03f-6466-4e44-9583-bd7f9d7bb6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b754a79158403cb50ee711c401ff33, user_id=54b47cf3212a4d18bf3b11b8e67697eb, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:14.971619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6a03f-6466-4e44-9583-bd7f9d7bb6d6 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:14.988552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1307/2591] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:14 2022] PUT /identity/v3/projects/f6b754a79158403cb50ee711c401ff33/users/54b47cf3212a4d18bf3b11b8e67697eb/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:14.999733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cd0a1-89fe-4577-b2c6-e0140ebd5d8a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:14.999963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cd0a1-89fe-4577-b2c6-e0140ebd5d8a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.000319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cd0a1-89fe-4577-b2c6-e0140ebd5d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.029291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7b8cd0a1-89fe-4577-b2c6-e0140ebd5d8a None None] MFA Rules not processed for user `54b47cf3212a4d18bf3b11b8e67697eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:15.030514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7b8cd0a1-89fe-4577-b2c6-e0140ebd5d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:15.101520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1285/2592] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:15.105678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6a03f-6466-4e44-9583-bd7f9d7bb6d6 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:15.170472 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6a03f-6466-4e44-9583-bd7f9d7bb6d6 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:15.175276 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c208cb5-4f99-45f3-bd8d-dd6035337048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:15.175909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c208cb5-4f99-45f3-bd8d-dd6035337048 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.176188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c208cb5-4f99-45f3-bd8d-dd6035337048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.176456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c208cb5-4f99-45f3-bd8d-dd6035337048 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.177098 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c208cb5-4f99-45f3-bd8d-dd6035337048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:15.179467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c208cb5-4f99-45f3-bd8d-dd6035337048 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:15.212885 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1308/2593] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:15 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:15.217005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cd0a1-89fe-4577-b2c6-e0140ebd5d8a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:15.229339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cd0a1-89fe-4577-b2c6-e0140ebd5d8a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:15.286392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2c108-6cf6-4673-af4f-c42ed61a8ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:15.286921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2c108-6cf6-4673-af4f-c42ed61a8ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.287200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2c108-6cf6-4673-af4f-c42ed61a8ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.287577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2c108-6cf6-4673-af4f-c42ed61a8ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.288221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2c108-6cf6-4673-af4f-c42ed61a8ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:15.290184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2c108-6cf6-4673-af4f-c42ed61a8ac5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:15.313439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1286/2594] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:15 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:28:15.318323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c208cb5-4f99-45f3-bd8d-dd6035337048 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:15.329579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c208cb5-4f99-45f3-bd8d-dd6035337048 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:15.334930 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c6ada-39b2-4140-bdd7-63f44eddd976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:15.335633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c6ada-39b2-4140-bdd7-63f44eddd976 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.335963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c6ada-39b2-4140-bdd7-63f44eddd976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.336275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c6ada-39b2-4140-bdd7-63f44eddd976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.336933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c6ada-39b2-4140-bdd7-63f44eddd976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:15.338732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c6ada-39b2-4140-bdd7-63f44eddd976 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:15.353290 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1309/2595] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:15.358488 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2c108-6cf6-4673-af4f-c42ed61a8ac5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:15.369232 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2c108-6cf6-4673-af4f-c42ed61a8ac5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:15.374700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b75289-69d8-465b-96f5-b74a42477ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:15.374918 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b75289-69d8-465b-96f5-b74a42477ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.375198 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b75289-69d8-465b-96f5-b74a42477ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.375503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b75289-69d8-465b-96f5-b74a42477ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.376424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b75289-69d8-465b-96f5-b74a42477ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:15.378039 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b75289-69d8-465b-96f5-b74a42477ae6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:15.388857 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1287/2596] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:15.393176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c6ada-39b2-4140-bdd7-63f44eddd976 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:15.403955 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c6ada-39b2-4140-bdd7-63f44eddd976 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:15.408580 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd8b4b-3f9a-4729-9107-98457889e806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:15.409326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd8b4b-3f9a-4729-9107-98457889e806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.409638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd8b4b-3f9a-4729-9107-98457889e806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.409908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd8b4b-3f9a-4729-9107-98457889e806 admin admin] PATH_INFO: `/v3/projects/8f33dd21a3f54cc1b21d01eb05414ad5/users/548015d076f0495ba11c1744dc732757/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.426674 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd8b4b-3f9a-4729-9107-98457889e806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f33dd21a3f54cc1b21d01eb05414ad5, user_id=548015d076f0495ba11c1744dc732757, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:15.429453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd8b4b-3f9a-4729-9107-98457889e806 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:15.444896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1310/2597] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:15 2022] PUT /identity/v3/projects/8f33dd21a3f54cc1b21d01eb05414ad5/users/548015d076f0495ba11c1744dc732757/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:15.455729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81132b-2b55-41c5-a962-65dd34fe3fd1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.456081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81132b-2b55-41c5-a962-65dd34fe3fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.456363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81132b-2b55-41c5-a962-65dd34fe3fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.494092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-df81132b-2b55-41c5-a962-65dd34fe3fd1 None None] MFA Rules not processed for user `548015d076f0495ba11c1744dc732757`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:15.495325 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-df81132b-2b55-41c5-a962-65dd34fe3fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:15.508396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:15.570710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1288/2598] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:15.575285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd8b4b-3f9a-4729-9107-98457889e806 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:15.594413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:15.642061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd8b4b-3f9a-4729-9107-98457889e806 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:15.647179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094c0a8-d950-4569-b9f9-e6a7ada466ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:15.647812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094c0a8-d950-4569-b9f9-e6a7ada466ac admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.648092 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094c0a8-d950-4569-b9f9-e6a7ada466ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.648363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094c0a8-d950-4569-b9f9-e6a7ada466ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.648993 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094c0a8-d950-4569-b9f9-e6a7ada466ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:15.650931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094c0a8-d950-4569-b9f9-e6a7ada466ac admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:15.679774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1311/2599] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:15 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:15.686543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81132b-2b55-41c5-a962-65dd34fe3fd1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:15.705110 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81132b-2b55-41c5-a962-65dd34fe3fd1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:15.768539 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0cbe6-df05-439d-833a-0bf2e9d19709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:15.769257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0cbe6-df05-439d-833a-0bf2e9d19709 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.769607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0cbe6-df05-439d-833a-0bf2e9d19709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.769996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0cbe6-df05-439d-833a-0bf2e9d19709 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.770770 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0cbe6-df05-439d-833a-0bf2e9d19709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:15.773098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0cbe6-df05-439d-833a-0bf2e9d19709 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:15.798933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1289/2600] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:15 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:15.803139 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094c0a8-d950-4569-b9f9-e6a7ada466ac admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:15.814527 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094c0a8-d950-4569-b9f9-e6a7ada466ac admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:15.820890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb10d1-4c17-49c7-ad06-ceeb9fe6f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:15.821566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb10d1-4c17-49c7-ad06-ceeb9fe6f2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.821928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb10d1-4c17-49c7-ad06-ceeb9fe6f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.822333 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb10d1-4c17-49c7-ad06-ceeb9fe6f2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.822982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb10d1-4c17-49c7-ad06-ceeb9fe6f2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:15.824636 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb10d1-4c17-49c7-ad06-ceeb9fe6f2d0 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:15.837934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1312/2601] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:28:15.842833 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0cbe6-df05-439d-833a-0bf2e9d19709 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:15.854428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0cbe6-df05-439d-833a-0bf2e9d19709 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:15.859500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287c5f0-dbc6-4617-9f4b-eafd991653fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:15.860285 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c5f0-dbc6-4617-9f4b-eafd991653fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.860628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c5f0-dbc6-4617-9f4b-eafd991653fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.860968 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c5f0-dbc6-4617-9f4b-eafd991653fb admin admin] PATH_INFO: `/v3/projects/7393380770474622a4f3ab5d243aee9f/users/8d7f3da602a141e5852a8ab5e3dea869/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.876880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287c5f0-dbc6-4617-9f4b-eafd991653fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7393380770474622a4f3ab5d243aee9f, user_id=8d7f3da602a141e5852a8ab5e3dea869, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:15.879729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287c5f0-dbc6-4617-9f4b-eafd991653fb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:15.893914 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1290/2602] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:15 2022] PUT /identity/v3/projects/7393380770474622a4f3ab5d243aee9f/users/8d7f3da602a141e5852a8ab5e3dea869/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:15.898416 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb10d1-4c17-49c7-ad06-ceeb9fe6f2d0 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:15.910326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb10d1-4c17-49c7-ad06-ceeb9fe6f2d0 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:15.975934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0aadec-4448-43f9-a557-0589dea0d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:15.976638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0aadec-4448-43f9-a557-0589dea0d55a admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:15.976984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0aadec-4448-43f9-a557-0589dea0d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:15.977377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0aadec-4448-43f9-a557-0589dea0d55a admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:15.978061 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0aadec-4448-43f9-a557-0589dea0d55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:15.979799 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0aadec-4448-43f9-a557-0589dea0d55a admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:15.990966 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1313/2603] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:15.995366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287c5f0-dbc6-4617-9f4b-eafd991653fb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:16.005893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287c5f0-dbc6-4617-9f4b-eafd991653fb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:16.011966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e6e23-3b03-496d-9394-1e5576ff2d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:16.012632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e6e23-3b03-496d-9394-1e5576ff2d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:16.012908 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e6e23-3b03-496d-9394-1e5576ff2d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:16.013178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e6e23-3b03-496d-9394-1e5576ff2d32 admin admin] PATH_INFO: `/v3/projects/7393380770474622a4f3ab5d243aee9f/users/8d7f3da602a141e5852a8ab5e3dea869/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:16.015132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e6e23-3b03-496d-9394-1e5576ff2d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7393380770474622a4f3ab5d243aee9f, user_id=8d7f3da602a141e5852a8ab5e3dea869, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:16.017817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e6e23-3b03-496d-9394-1e5576ff2d32 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:16.028818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1291/2604] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:15 2022] PUT /identity/v3/projects/7393380770474622a4f3ab5d243aee9f/users/8d7f3da602a141e5852a8ab5e3dea869/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:16.039991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cddd9d-0f10-41ba-8838-4ce51513495e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:16.040279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cddd9d-0f10-41ba-8838-4ce51513495e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:16.040552 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cddd9d-0f10-41ba-8838-4ce51513495e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:16.068785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-50cddd9d-0f10-41ba-8838-4ce51513495e None None] MFA Rules not processed for user `8d7f3da602a141e5852a8ab5e3dea869`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:16.070010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-50cddd9d-0f10-41ba-8838-4ce51513495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:16.139401 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1314/2605] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:16.150834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e6e23-3b03-496d-9394-1e5576ff2d32 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:16.152551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-666e6e23-3b03-496d-9394-1e5576ff2d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:16.212001 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e6e23-3b03-496d-9394-1e5576ff2d32 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:16.216196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65b180-2beb-45ad-88ac-88f93f52f565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:16.216825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65b180-2beb-45ad-88ac-88f93f52f565 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:16.217105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65b180-2beb-45ad-88ac-88f93f52f565 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:16.217690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65b180-2beb-45ad-88ac-88f93f52f565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:16.227085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65b180-2beb-45ad-88ac-88f93f52f565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:16.228576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65b180-2beb-45ad-88ac-88f93f52f565 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:16.244320 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1292/2606] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:16.817186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cddd9d-0f10-41ba-8838-4ce51513495e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:16.818678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-50cddd9d-0f10-41ba-8838-4ce51513495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:16.832024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cddd9d-0f10-41ba-8838-4ce51513495e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:16.836428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c089-9f25-4085-a960-f9d84c477d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:16.837026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c089-9f25-4085-a960-f9d84c477d2c service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:16.837368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c089-9f25-4085-a960-f9d84c477d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:16.837643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c089-9f25-4085-a960-f9d84c477d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:16.846719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:16.897691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17c089-9f25-4085-a960-f9d84c477d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:16.899150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17c089-9f25-4085-a960-f9d84c477d2c service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:16.909377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1315/2607] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:21.049698 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65b180-2beb-45ad-88ac-88f93f52f565 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:21.058616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65b180-2beb-45ad-88ac-88f93f52f565 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:21.062604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944648d-f309-4df4-a2d6-1caab731275a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:21.063263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944648d-f309-4df4-a2d6-1caab731275a service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:21.063623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944648d-f309-4df4-a2d6-1caab731275a service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:21.063866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944648d-f309-4df4-a2d6-1caab731275a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:21.069699 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:21.125962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944648d-f309-4df4-a2d6-1caab731275a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:21.127437 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944648d-f309-4df4-a2d6-1caab731275a service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:21.137765 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1293/2608] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:23.326219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c089-9f25-4085-a960-f9d84c477d2c service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:23.419657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c089-9f25-4085-a960-f9d84c477d2c service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:23.435033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:23.435999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:23.436425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:23.436742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] PATH_INFO: `/v3/users/54b47cf3212a4d18bf3b11b8e67697eb` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:23.437919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b47cf3212a4d18bf3b11b8e67697eb)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:23.442953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:23.520065 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b47cf3212a4d18bf3b11b8e67697eb'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:23.539623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b47cf3212a4d18bf3b11b8e67697eb'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:23.547293 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b47cf3212a4d18bf3b11b8e67697eb'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:23.548136 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b47cf3212a4d18bf3b11b8e67697eb'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:23.548793 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b47cf3212a4d18bf3b11b8e67697eb'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:23.567819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1316/2609] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:23 2022] DELETE /identity/v3/users/54b47cf3212a4d18bf3b11b8e67697eb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:23.572617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c1d6-6369-4f70-b167-9c4e836a4063 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:23.573170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c1d6-6369-4f70-b167-9c4e836a4063 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:23.573480 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c1d6-6369-4f70-b167-9c4e836a4063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:23.605808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6ac9c1d6-6369-4f70-b167-9c4e836a4063 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:23.607600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6ac9c1d6-6369-4f70-b167-9c4e836a4063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:23.685530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1294/2610] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:23.700408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:23.702370 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:23.762734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:23.791714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a44b5-0b0e-4aa0-9bf7-7f6cf8bfc097 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:23.795322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc410b-1e9a-4ec6-9e41-28d2b623e76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:23.795966 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc410b-1e9a-4ec6-9e41-28d2b623e76e service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:23.796247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc410b-1e9a-4ec6-9e41-28d2b623e76e service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:23.796520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc410b-1e9a-4ec6-9e41-28d2b623e76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:23.807835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc410b-1e9a-4ec6-9e41-28d2b623e76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:23.809566 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc410b-1e9a-4ec6-9e41-28d2b623e76e service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:23.819453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1317/2611] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:23.958632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c1d6-6369-4f70-b167-9c4e836a4063 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:23.960406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6ac9c1d6-6369-4f70-b167-9c4e836a4063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:23.979550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c1d6-6369-4f70-b167-9c4e836a4063 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:23.986930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:23.987825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:23.988112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:23.988385 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] PATH_INFO: `/v3/users/2b73ee04318147fe923c80760c3b6cf8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:23.989734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b73ee04318147fe923c80760c3b6cf8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:23.991776 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.050984 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b73ee04318147fe923c80760c3b6cf8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.062907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b73ee04318147fe923c80760c3b6cf8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.070808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b73ee04318147fe923c80760c3b6cf8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.071584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b73ee04318147fe923c80760c3b6cf8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.072267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b73ee04318147fe923c80760c3b6cf8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.090571 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1295/2612] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:23 2022] DELETE /identity/v3/users/2b73ee04318147fe923c80760c3b6cf8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:24.109313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc410b-1e9a-4ec6-9e41-28d2b623e76e service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.110862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1cdc410b-1e9a-4ec6-9e41-28d2b623e76e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:24.124400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc410b-1e9a-4ec6-9e41-28d2b623e76e service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:24.206950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:24.207627 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.207913 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.208190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] PATH_INFO: `/v3/projects/f6b754a79158403cb50ee711c401ff33` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.209426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b754a79158403cb50ee711c401ff33)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:24.211796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.261427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b754a79158403cb50ee711c401ff33', 'request_id': 'req-373531b1-a202-44c4-b6a5-37ee64ad5ca3'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.277947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b754a79158403cb50ee711c401ff33', 'request_id': 'req-373531b1-a202-44c4-b6a5-37ee64ad5ca3'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.292446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b754a79158403cb50ee711c401ff33', 'request_id': 'req-373531b1-a202-44c4-b6a5-37ee64ad5ca3'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.294859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.294859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:24.302654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] The token cache is being invalidate because project f6b754a79158403cb50ee711c401ff33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:24.302985 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.306499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.306499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1318/2613] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:24 2022] DELETE /identity/v3/projects/f6b754a79158403cb50ee711c401ff33 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:24.311520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.311520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:24.319155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8496e5-8f80-4feb-b9bc-1adf23e337bb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:24.342171 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:24.380947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373531b1-a202-44c4-b6a5-37ee64ad5ca3 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:24.386886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:24.387626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.387904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.388196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] PATH_INFO: `/v3/users/548015d076f0495ba11c1744dc732757` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.389330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548015d076f0495ba11c1744dc732757)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:24.390200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:24.390842 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.391123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.391339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.391459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] PATH_INFO: `/v3/projects/70423e023e344254a30823d49077937e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.392562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70423e023e344254a30823d49077937e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:24.394255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:24.394448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.451080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548015d076f0495ba11c1744dc732757'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.451540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70423e023e344254a30823d49077937e', 'request_id': 'req-1b237e13-a33d-49ab-b677-f4b78e9f9594'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.461277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70423e023e344254a30823d49077937e', 'request_id': 'req-1b237e13-a33d-49ab-b677-f4b78e9f9594'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.464306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548015d076f0495ba11c1744dc732757'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.468529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70423e023e344254a30823d49077937e', 'request_id': 'req-1b237e13-a33d-49ab-b677-f4b78e9f9594'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.471517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548015d076f0495ba11c1744dc732757'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.472256 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548015d076f0495ba11c1744dc732757'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.472864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-21a9d0a2-0b4a-45ec-9576-f20846f8be67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548015d076f0495ba11c1744dc732757'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.480291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] The token cache is being invalidate because project 70423e023e344254a30823d49077937e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:24.480571 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.481397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1b237e13-a33d-49ab-b677-f4b78e9f9594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.483153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1296/2614] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:24 2022] DELETE /identity/v3/projects/70423e023e344254a30823d49077937e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:24.487329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1319/2615] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:24 2022] DELETE /identity/v3/users/548015d076f0495ba11c1744dc732757 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:24.488239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca4f87-3457-4cf8-805e-b30b3f274f6c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.488524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca4f87-3457-4cf8-805e-b30b3f274f6c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.488797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca4f87-3457-4cf8-805e-b30b3f274f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.511041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-faca4f87-3457-4cf8-805e-b30b3f274f6c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:24.512303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-faca4f87-3457-4cf8-805e-b30b3f274f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:24.576420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1297/2616] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:24.584352 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60ee70-5125-4c35-bb9d-1142c8a31a7f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.584672 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60ee70-5125-4c35-bb9d-1142c8a31a7f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.585117 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60ee70-5125-4c35-bb9d-1142c8a31a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.608068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-db60ee70-5125-4c35-bb9d-1142c8a31a7f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:24.609278 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-db60ee70-5125-4c35-bb9d-1142c8a31a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:24.618858 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1320/2617] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:24.623440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca4f87-3457-4cf8-805e-b30b3f274f6c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.634134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca4f87-3457-4cf8-805e-b30b3f274f6c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:24.639670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f28d7-be74-43ea-9385-4ef689c52312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:24.640382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f28d7-be74-43ea-9385-4ef689c52312 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.640664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f28d7-be74-43ea-9385-4ef689c52312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.640932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f28d7-be74-43ea-9385-4ef689c52312 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.641643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f28d7-be74-43ea-9385-4ef689c52312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:28:24.642034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f28d7-be74-43ea-9385-4ef689c52312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:24.643594 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f28d7-be74-43ea-9385-4ef689c52312 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.657222 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1298/2618] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:28:24.661479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60ee70-5125-4c35-bb9d-1142c8a31a7f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.671204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60ee70-5125-4c35-bb9d-1142c8a31a7f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:24.676123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d241e92-8468-4d5f-85bd-b83938b7d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:24.676795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d241e92-8468-4d5f-85bd-b83938b7d296 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.677134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d241e92-8468-4d5f-85bd-b83938b7d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.677407 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d241e92-8468-4d5f-85bd-b83938b7d296 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.678040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d241e92-8468-4d5f-85bd-b83938b7d296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:24.680368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d241e92-8468-4d5f-85bd-b83938b7d296 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.708915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1321/2619] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:24 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:24.713283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f28d7-be74-43ea-9385-4ef689c52312 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.723539 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f28d7-be74-43ea-9385-4ef689c52312 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:24.756982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:24.771177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d241e92-8468-4d5f-85bd-b83938b7d296 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.773913 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7d241e92-8468-4d5f-85bd-b83938b7d296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:24.792622 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d0770-48c3-4d28-9984-453586ebfefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:24.793462 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d0770-48c3-4d28-9984-453586ebfefc admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.793648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d0770-48c3-4d28-9984-453586ebfefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.793909 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d0770-48c3-4d28-9984-453586ebfefc admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.794543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d0770-48c3-4d28-9984-453586ebfefc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:24.796549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d0770-48c3-4d28-9984-453586ebfefc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.822546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1299/2620] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:24 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:28:24.826383 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d0770-48c3-4d28-9984-453586ebfefc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.837489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d0770-48c3-4d28-9984-453586ebfefc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:24.842406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9c52-fbea-45d8-b2ed-4c2ffa48c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:24.842625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d241e92-8468-4d5f-85bd-b83938b7d296 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:24.843012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9c52-fbea-45d8-b2ed-4c2ffa48c447 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.843412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9c52-fbea-45d8-b2ed-4c2ffa48c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.843686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9c52-fbea-45d8-b2ed-4c2ffa48c447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.844334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9c52-fbea-45d8-b2ed-4c2ffa48c447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:24.845930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9c52-fbea-45d8-b2ed-4c2ffa48c447 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.847300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:24.847922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.848197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.848462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] PATH_INFO: `/v3/projects/8f33dd21a3f54cc1b21d01eb05414ad5` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.849570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f33dd21a3f54cc1b21d01eb05414ad5)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:24.851680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.856707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1300/2621] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:28:24.861672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9c52-fbea-45d8-b2ed-4c2ffa48c447 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.871458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9c52-fbea-45d8-b2ed-4c2ffa48c447 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:24.876568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3846-9be6-4e0f-9ff4-3183620308fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:24.877149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3846-9be6-4e0f-9ff4-3183620308fa admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.877430 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3846-9be6-4e0f-9ff4-3183620308fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.877697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3846-9be6-4e0f-9ff4-3183620308fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.878332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb3846-9be6-4e0f-9ff4-3183620308fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:24.879943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb3846-9be6-4e0f-9ff4-3183620308fa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.890263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1301/2622] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:28:24.894823 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3846-9be6-4e0f-9ff4-3183620308fa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.903422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f33dd21a3f54cc1b21d01eb05414ad5', 'request_id': 'req-53dc46ed-4c99-4310-8d71-89b6277656dc'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.904782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3846-9be6-4e0f-9ff4-3183620308fa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:24.907352 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:24.913155 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f33dd21a3f54cc1b21d01eb05414ad5', 'request_id': 'req-53dc46ed-4c99-4310-8d71-89b6277656dc'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.922134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f33dd21a3f54cc1b21d01eb05414ad5', 'request_id': 'req-53dc46ed-4c99-4310-8d71-89b6277656dc'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.933021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] The token cache is being invalidate because project 8f33dd21a3f54cc1b21d01eb05414ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:24.933380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.934044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:24.935604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1322/2623] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:24 2022] DELETE /identity/v3/projects/8f33dd21a3f54cc1b21d01eb05414ad5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:24.939459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:24.940799 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:24.963619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a197-f2fa-4ce0-9063-7c51797024a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:24.964282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a197-f2fa-4ce0-9063-7c51797024a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:24.964552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a197-f2fa-4ce0-9063-7c51797024a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:24.964822 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a197-f2fa-4ce0-9063-7c51797024a7 admin admin] PATH_INFO: `/v3/projects/480c2cb3ae354741938d9eaa6e2a9fcb/users/4c310b330d8c43e987dcd29193042c87/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:24.980080 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a197-f2fa-4ce0-9063-7c51797024a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480c2cb3ae354741938d9eaa6e2a9fcb, user_id=4c310b330d8c43e987dcd29193042c87, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:24.983217 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a197-f2fa-4ce0-9063-7c51797024a7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:24.998168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1302/2624] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:24 2022] PUT /identity/v3/projects/480c2cb3ae354741938d9eaa6e2a9fcb/users/4c310b330d8c43e987dcd29193042c87/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:25.003219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684d39f-8265-4ac5-95e3-f51b66afd5ce None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.003529 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684d39f-8265-4ac5-95e3-f51b66afd5ce None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.003803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684d39f-8265-4ac5-95e3-f51b66afd5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.006758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc46ed-4c99-4310-8d71-89b6277656dc admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:25.027241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d684d39f-8265-4ac5-95e3-f51b66afd5ce None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:25.028510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d684d39f-8265-4ac5-95e3-f51b66afd5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:25.067889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:25.068521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.068800 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.069099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] PATH_INFO: `/v3/users/8d7f3da602a141e5852a8ab5e3dea869` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.070544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7f3da602a141e5852a8ab5e3dea869)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:25.072439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:25.099098 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1303/2625] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:28:25.109828 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684d39f-8265-4ac5-95e3-f51b66afd5ce None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:25.111591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d684d39f-8265-4ac5-95e3-f51b66afd5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:25.134253 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7f3da602a141e5852a8ab5e3dea869'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:25.147705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7f3da602a141e5852a8ab5e3dea869'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:25.151584 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:25.155640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7f3da602a141e5852a8ab5e3dea869'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:25.156322 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7f3da602a141e5852a8ab5e3dea869'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:25.156964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7f3da602a141e5852a8ab5e3dea869'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:25.172118 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1323/2626] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:24 2022] DELETE /identity/v3/users/8d7f3da602a141e5852a8ab5e3dea869 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:25.179546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684d39f-8265-4ac5-95e3-f51b66afd5ce None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:25.233869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376e881-84b6-49d8-bc62-59d35e4373b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:25.234485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e881-84b6-49d8-bc62-59d35e4373b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.234759 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e881-84b6-49d8-bc62-59d35e4373b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.235054 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e881-84b6-49d8-bc62-59d35e4373b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.236916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e376e881-84b6-49d8-bc62-59d35e4373b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:25.301957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376e881-84b6-49d8-bc62-59d35e4373b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:25.303433 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376e881-84b6-49d8-bc62-59d35e4373b7 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:25.313278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1304/2627] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:25.455590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:25.457292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:25.480100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996be07-2dca-48b2-b046-4636fdb17347 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:25.490773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:25.491663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.491850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.492141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] PATH_INFO: `/v3/projects/7393380770474622a4f3ab5d243aee9f` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.494034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7393380770474622a4f3ab5d243aee9f)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:25.496191 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:25.498775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:25.549167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7393380770474622a4f3ab5d243aee9f', 'request_id': 'req-49418a2c-59b9-44cf-8107-1b58d4372f78'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:25.557631 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7393380770474622a4f3ab5d243aee9f', 'request_id': 'req-49418a2c-59b9-44cf-8107-1b58d4372f78'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:25.564329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7393380770474622a4f3ab5d243aee9f', 'request_id': 'req-49418a2c-59b9-44cf-8107-1b58d4372f78'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:25.576294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] The token cache is being invalidate because project 7393380770474622a4f3ab5d243aee9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:25.576557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:25.577245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-49418a2c-59b9-44cf-8107-1b58d4372f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:25.579018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1324/2628] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:25 2022] DELETE /identity/v3/projects/7393380770474622a4f3ab5d243aee9f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:25.585081 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f26771-a7af-4aad-84c7-0aa39fa25363 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.585562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f26771-a7af-4aad-84c7-0aa39fa25363 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.585786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f26771-a7af-4aad-84c7-0aa39fa25363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.606464 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-86f26771-a7af-4aad-84c7-0aa39fa25363 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:25.607624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-86f26771-a7af-4aad-84c7-0aa39fa25363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:25.686028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1305/2629] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:28:25.695074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88664c95-79c2-4113-9ebb-2268bec48f37 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.695981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88664c95-79c2-4113-9ebb-2268bec48f37 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.696262 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88664c95-79c2-4113-9ebb-2268bec48f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.720914 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-88664c95-79c2-4113-9ebb-2268bec48f37 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:25.722134 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-88664c95-79c2-4113-9ebb-2268bec48f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:25.730721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1325/2630] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:25.734955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f26771-a7af-4aad-84c7-0aa39fa25363 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:25.746577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f26771-a7af-4aad-84c7-0aa39fa25363 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:25.752361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b7229-4eb8-4a23-a6f0-4468d86b7585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:25.752994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7229-4eb8-4a23-a6f0-4468d86b7585 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.753267 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7229-4eb8-4a23-a6f0-4468d86b7585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.753538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7229-4eb8-4a23-a6f0-4468d86b7585 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.754244 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b7229-4eb8-4a23-a6f0-4468d86b7585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:28:25.754473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b7229-4eb8-4a23-a6f0-4468d86b7585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:25.756126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b7229-4eb8-4a23-a6f0-4468d86b7585 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:25.770817 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1306/2631] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:28:25.775128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88664c95-79c2-4113-9ebb-2268bec48f37 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:25.785365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88664c95-79c2-4113-9ebb-2268bec48f37 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:25.792570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf3730-c50a-4fd8-bd82-6ad2ce24d8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:25.793224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3730-c50a-4fd8-bd82-6ad2ce24d8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.793501 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3730-c50a-4fd8-bd82-6ad2ce24d8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.793792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3730-c50a-4fd8-bd82-6ad2ce24d8b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.794425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf3730-c50a-4fd8-bd82-6ad2ce24d8b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:25.796419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf3730-c50a-4fd8-bd82-6ad2ce24d8b7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:25.824684 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1326/2632] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:25 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:25.828830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b7229-4eb8-4a23-a6f0-4468d86b7585 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:25.839281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b7229-4eb8-4a23-a6f0-4468d86b7585 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:25.858548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:25.897686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ee43d-4167-4edf-af51-c2d2bf1ea883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:25.898613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ee43d-4167-4edf-af51-c2d2bf1ea883 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.898896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ee43d-4167-4edf-af51-c2d2bf1ea883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.899173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ee43d-4167-4edf-af51-c2d2bf1ea883 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.900180 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ee43d-4167-4edf-af51-c2d2bf1ea883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:25.901903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ee43d-4167-4edf-af51-c2d2bf1ea883 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:25.925923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1307/2633] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:25 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:25.930338 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf3730-c50a-4fd8-bd82-6ad2ce24d8b7 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:25.941161 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf3730-c50a-4fd8-bd82-6ad2ce24d8b7 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:25.946991 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f33e6b-d316-4c61-816f-d2869f6714be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:25.947639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f33e6b-d316-4c61-816f-d2869f6714be admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.947918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f33e6b-d316-4c61-816f-d2869f6714be admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.948188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f33e6b-d316-4c61-816f-d2869f6714be admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.948830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f33e6b-d316-4c61-816f-d2869f6714be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:25.950451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f33e6b-d316-4c61-816f-d2869f6714be admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:25.964467 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1327/2634] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:25.965710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ee43d-4167-4edf-af51-c2d2bf1ea883 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:25.976412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ee43d-4167-4edf-af51-c2d2bf1ea883 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:25.981727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c43e2e-0d5c-4a8b-b2ed-459348188de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:25.982348 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43e2e-0d5c-4a8b-b2ed-459348188de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:25.982628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43e2e-0d5c-4a8b-b2ed-459348188de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:25.982905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43e2e-0d5c-4a8b-b2ed-459348188de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:25.986664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c43e2e-0d5c-4a8b-b2ed-459348188de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:25.989043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c43e2e-0d5c-4a8b-b2ed-459348188de5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:26.000386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1308/2635] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:26.004537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f33e6b-d316-4c61-816f-d2869f6714be admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:26.016797 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f33e6b-d316-4c61-816f-d2869f6714be admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:26.025336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe48c4-f567-427e-9cb0-9fcb2ce2c7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:26.026809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe48c4-f567-427e-9cb0-9fcb2ce2c7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:26.027097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe48c4-f567-427e-9cb0-9fcb2ce2c7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:26.027477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe48c4-f567-427e-9cb0-9fcb2ce2c7e9 admin admin] PATH_INFO: `/v3/projects/8375b23c196f46e4b2b39a88357c5478/users/9a8a9dd720284dfea10d746d22689ce5/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:26.048297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe48c4-f567-427e-9cb0-9fcb2ce2c7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8375b23c196f46e4b2b39a88357c5478, user_id=9a8a9dd720284dfea10d746d22689ce5, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:26.051196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe48c4-f567-427e-9cb0-9fcb2ce2c7e9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:26.067287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1328/2636] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:26 2022] PUT /identity/v3/projects/8375b23c196f46e4b2b39a88357c5478/users/9a8a9dd720284dfea10d746d22689ce5/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:26.079667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddd7cd-65e8-4434-aa91-1d938151e07b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:26.079952 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddd7cd-65e8-4434-aa91-1d938151e07b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:26.080227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddd7cd-65e8-4434-aa91-1d938151e07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:26.113536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c4ddd7cd-65e8-4434-aa91-1d938151e07b None None] MFA Rules not processed for user `9a8a9dd720284dfea10d746d22689ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:26.114723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c4ddd7cd-65e8-4434-aa91-1d938151e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:26.199575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1309/2637] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:26.200851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe48c4-f567-427e-9cb0-9fcb2ce2c7e9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:26.277606 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe48c4-f567-427e-9cb0-9fcb2ce2c7e9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:26.282255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45433c0f-d9e3-4d00-9278-55d27602139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:26.282867 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45433c0f-d9e3-4d00-9278-55d27602139b admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:26.283143 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45433c0f-d9e3-4d00-9278-55d27602139b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:26.283435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45433c0f-d9e3-4d00-9278-55d27602139b admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:26.284080 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45433c0f-d9e3-4d00-9278-55d27602139b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:26.285989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45433c0f-d9e3-4d00-9278-55d27602139b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:26.319558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1329/2638] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:26 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:26.321047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddd7cd-65e8-4434-aa91-1d938151e07b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:26.333841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddd7cd-65e8-4434-aa91-1d938151e07b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:26.396195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f990-f997-41a1-b720-393aade5c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:26.396731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f990-f997-41a1-b720-393aade5c11f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:26.397234 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f990-f997-41a1-b720-393aade5c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:26.397368 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f990-f997-41a1-b720-393aade5c11f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:26.397933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747f990-f997-41a1-b720-393aade5c11f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:26.400075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747f990-f997-41a1-b720-393aade5c11f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:26.425757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1310/2639] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:26 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:28:26.428630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45433c0f-d9e3-4d00-9278-55d27602139b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:26.440029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45433c0f-d9e3-4d00-9278-55d27602139b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:26.447870 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74b85c-b7ce-4ebd-86fa-87dead7be549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:26.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74b85c-b7ce-4ebd-86fa-87dead7be549 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:26.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74b85c-b7ce-4ebd-86fa-87dead7be549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:26.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74b85c-b7ce-4ebd-86fa-87dead7be549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:26.449927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74b85c-b7ce-4ebd-86fa-87dead7be549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:26.451700 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74b85c-b7ce-4ebd-86fa-87dead7be549 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:26.463714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1330/2640] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:26.469554 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f990-f997-41a1-b720-393aade5c11f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:26.481046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f990-f997-41a1-b720-393aade5c11f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:26.487496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d25ccf-66b4-43a5-87c6-e7007b82905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:26.487825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d25ccf-66b4-43a5-87c6-e7007b82905d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:26.488175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d25ccf-66b4-43a5-87c6-e7007b82905d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:26.488613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d25ccf-66b4-43a5-87c6-e7007b82905d admin admin] PATH_INFO: `/v3/projects/c7ce37641c2b452fb430f5d5663a4f9b/users/61cca303b37b4e9eb08fe2e7d9177cdb/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:26.506922 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d25ccf-66b4-43a5-87c6-e7007b82905d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ce37641c2b452fb430f5d5663a4f9b, user_id=61cca303b37b4e9eb08fe2e7d9177cdb, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:26.509904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d25ccf-66b4-43a5-87c6-e7007b82905d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:26.513457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:26.530743 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1311/2641] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:26 2022] PUT /identity/v3/projects/c7ce37641c2b452fb430f5d5663a4f9b/users/61cca303b37b4e9eb08fe2e7d9177cdb/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:26.534521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74b85c-b7ce-4ebd-86fa-87dead7be549 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:26.540951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:26.546734 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74b85c-b7ce-4ebd-86fa-87dead7be549 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:26.628491 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bbfc2-89b6-4071-afe2-e0e44f89e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:26.629222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bbfc2-89b6-4071-afe2-e0e44f89e742 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:26.629599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bbfc2-89b6-4071-afe2-e0e44f89e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:26.629944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bbfc2-89b6-4071-afe2-e0e44f89e742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:26.630881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bbfc2-89b6-4071-afe2-e0e44f89e742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:26.632633 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bbfc2-89b6-4071-afe2-e0e44f89e742 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:26.645514 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1331/2642] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:26.651115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d25ccf-66b4-43a5-87c6-e7007b82905d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:26.662124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d25ccf-66b4-43a5-87c6-e7007b82905d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:26.673679 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19acd0a-6f1e-4b01-bca2-d2d38829de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:26.674789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19acd0a-6f1e-4b01-bca2-d2d38829de48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:26.675226 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19acd0a-6f1e-4b01-bca2-d2d38829de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:26.675680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19acd0a-6f1e-4b01-bca2-d2d38829de48 admin admin] PATH_INFO: `/v3/projects/c7ce37641c2b452fb430f5d5663a4f9b/users/61cca303b37b4e9eb08fe2e7d9177cdb/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:26.678253 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19acd0a-6f1e-4b01-bca2-d2d38829de48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ce37641c2b452fb430f5d5663a4f9b, user_id=61cca303b37b4e9eb08fe2e7d9177cdb, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:26.684940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19acd0a-6f1e-4b01-bca2-d2d38829de48 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:26.701171 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1312/2643] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:26 2022] PUT /identity/v3/projects/c7ce37641c2b452fb430f5d5663a4f9b/users/61cca303b37b4e9eb08fe2e7d9177cdb/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:26.712105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c72665-8683-4de1-b8be-7fdd0818072f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:26.712428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c72665-8683-4de1-b8be-7fdd0818072f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:26.712705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c72665-8683-4de1-b8be-7fdd0818072f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:26.744847 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-72c72665-8683-4de1-b8be-7fdd0818072f None None] MFA Rules not processed for user `61cca303b37b4e9eb08fe2e7d9177cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:26.746075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-72c72665-8683-4de1-b8be-7fdd0818072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:26.824613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1332/2644] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:26.836649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19acd0a-6f1e-4b01-bca2-d2d38829de48 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:26.838593 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b19acd0a-6f1e-4b01-bca2-d2d38829de48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:26.918040 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19acd0a-6f1e-4b01-bca2-d2d38829de48 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:26.921882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36509597-63a0-425f-ab5f-1a277c5d2520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:26.922511 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509597-63a0-425f-ab5f-1a277c5d2520 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:26.922785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509597-63a0-425f-ab5f-1a277c5d2520 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:26.923056 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509597-63a0-425f-ab5f-1a277c5d2520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:26.941116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36509597-63a0-425f-ab5f-1a277c5d2520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:26.942585 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36509597-63a0-425f-ab5f-1a277c5d2520 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:26.962288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1313/2645] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:27.068185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c72665-8683-4de1-b8be-7fdd0818072f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:27.080738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c72665-8683-4de1-b8be-7fdd0818072f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:27.084422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a2f8e-165d-47c9-8f2f-f177c34f7b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:27.085095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a2f8e-165d-47c9-8f2f-f177c34f7b93 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:27.085403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a2f8e-165d-47c9-8f2f-f177c34f7b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:27.085675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a2f8e-165d-47c9-8f2f-f177c34f7b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:27.155538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a2f8e-165d-47c9-8f2f-f177c34f7b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:27.157250 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a2f8e-165d-47c9-8f2f-f177c34f7b93 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:27.169864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1333/2646] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:27.495684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36509597-63a0-425f-ab5f-1a277c5d2520 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:27.568550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36509597-63a0-425f-ab5f-1a277c5d2520 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:27.574118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:27.575001 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:27.575463 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:27.579693 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] PATH_INFO: `/v3/users/9a8a9dd720284dfea10d746d22689ce5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:27.581012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8a9dd720284dfea10d746d22689ce5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:27.583146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:27.654362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8a9dd720284dfea10d746d22689ce5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:27.669831 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8a9dd720284dfea10d746d22689ce5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:27.682672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8a9dd720284dfea10d746d22689ce5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:27.685125 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8a9dd720284dfea10d746d22689ce5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:27.685995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8a9dd720284dfea10d746d22689ce5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:27.712912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1314/2647] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:27 2022] DELETE /identity/v3/users/9a8a9dd720284dfea10d746d22689ce5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:27.714320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8291-10dc-4b2f-9413-e7e21ea35b8f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:27.715124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8291-10dc-4b2f-9413-e7e21ea35b8f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:27.715582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8291-10dc-4b2f-9413-e7e21ea35b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:27.738377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-652e8291-10dc-4b2f-9413-e7e21ea35b8f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:27.740597 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-652e8291-10dc-4b2f-9413-e7e21ea35b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:27.765550 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:27.816921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1334/2648] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:28:27.828477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:27.830009 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:27.845733 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:27.914517 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66deea7-1c2a-4542-8786-fe81d2b3f71b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:27.919360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa33135-2cb0-4312-bf6a-6e31213f142c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:27.920153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa33135-2cb0-4312-bf6a-6e31213f142c service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:27.920502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa33135-2cb0-4312-bf6a-6e31213f142c service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:27.920866 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa33135-2cb0-4312-bf6a-6e31213f142c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:27.934452 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa33135-2cb0-4312-bf6a-6e31213f142c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:27.936855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa33135-2cb0-4312-bf6a-6e31213f142c service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:27.950382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1315/2649] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:28.441048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e8291-10dc-4b2f-9413-e7e21ea35b8f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:28.442558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-652e8291-10dc-4b2f-9413-e7e21ea35b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:28.456995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e8291-10dc-4b2f-9413-e7e21ea35b8f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:28.464831 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:28.465541 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:28.465859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:28.466364 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] PATH_INFO: `/v3/projects/8375b23c196f46e4b2b39a88357c5478` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:28.468035 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8375b23c196f46e4b2b39a88357c5478)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:28.470205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:28.538235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8375b23c196f46e4b2b39a88357c5478', 'request_id': 'req-8e8aaedf-2651-4336-94e2-f6d822f21e7d'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:28.548176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8375b23c196f46e4b2b39a88357c5478', 'request_id': 'req-8e8aaedf-2651-4336-94e2-f6d822f21e7d'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:28.556439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8375b23c196f46e4b2b39a88357c5478', 'request_id': 'req-8e8aaedf-2651-4336-94e2-f6d822f21e7d'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:28.572649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] The token cache is being invalidate because project 8375b23c196f46e4b2b39a88357c5478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:28.573027 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:28.573768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:28.578612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1335/2650] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:28 2022] DELETE /identity/v3/projects/8375b23c196f46e4b2b39a88357c5478 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:28.579741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa33135-2cb0-4312-bf6a-6e31213f142c service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:28.589730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa33135-2cb0-4312-bf6a-6e31213f142c service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:28.656102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:28.656910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:28.657249 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:28.657583 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] PATH_INFO: `/v3/users/61cca303b37b4e9eb08fe2e7d9177cdb` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:28.659014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cca303b37b4e9eb08fe2e7d9177cdb)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:28.661365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:28.723860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cca303b37b4e9eb08fe2e7d9177cdb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:28.740166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cca303b37b4e9eb08fe2e7d9177cdb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:28.747872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cca303b37b4e9eb08fe2e7d9177cdb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:28.748656 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cca303b37b4e9eb08fe2e7d9177cdb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:28.749314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4630abc6-f0f4-4b0e-9ef8-39496d37f426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cca303b37b4e9eb08fe2e7d9177cdb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:28.764924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1316/2651] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:28 2022] DELETE /identity/v3/users/61cca303b37b4e9eb08fe2e7d9177cdb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:29.128607 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:29.130222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:29.154408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aaedf-2651-4336-94e2-f6d822f21e7d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:29.233272 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:29.234032 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.234378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.239620 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] PATH_INFO: `/v3/projects/c7ce37641c2b452fb430f5d5663a4f9b` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.240990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ce37641c2b452fb430f5d5663a4f9b)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:29.243099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:29.310897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:29.312297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ce37641c2b452fb430f5d5663a4f9b', 'request_id': 'req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:29.345737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ce37641c2b452fb430f5d5663a4f9b', 'request_id': 'req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:29.355642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ce37641c2b452fb430f5d5663a4f9b', 'request_id': 'req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:29.366837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] The token cache is being invalidate because project c7ce37641c2b452fb430f5d5663a4f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:29.367167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:29.368564 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb8c68d8-7412-4fa7-98b7-ee0b79d46467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:29.372481 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1336/2652] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:29 2022] DELETE /identity/v3/projects/c7ce37641c2b452fb430f5d5663a4f9b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:29.378432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181760e3-bd4c-4953-9a92-29d6c4e11b66 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.378716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181760e3-bd4c-4953-9a92-29d6c4e11b66 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.380174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181760e3-bd4c-4953-9a92-29d6c4e11b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.403371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-181760e3-bd4c-4953-9a92-29d6c4e11b66 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:29.404998 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-181760e3-bd4c-4953-9a92-29d6c4e11b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:29.428738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:29.481390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1317/2653] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:29.489434 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03446-62db-4bd0-a0cf-ec4d86592c7e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.490083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03446-62db-4bd0-a0cf-ec4d86592c7e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.491410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03446-62db-4bd0-a0cf-ec4d86592c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.516141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-45f03446-62db-4bd0-a0cf-ec4d86592c7e None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:29.517537 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-45f03446-62db-4bd0-a0cf-ec4d86592c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:29.527103 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1337/2654] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:28:29.531481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181760e3-bd4c-4953-9a92-29d6c4e11b66 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:29.546502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181760e3-bd4c-4953-9a92-29d6c4e11b66 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:29.551900 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44845a-fc59-4ef6-ab8a-eda456ed9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:29.552777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44845a-fc59-4ef6-ab8a-eda456ed9aea admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.553203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44845a-fc59-4ef6-ab8a-eda456ed9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.553647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44845a-fc59-4ef6-ab8a-eda456ed9aea admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.554648 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44845a-fc59-4ef6-ab8a-eda456ed9aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:28:29.555303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44845a-fc59-4ef6-ab8a-eda456ed9aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:29.557210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44845a-fc59-4ef6-ab8a-eda456ed9aea admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:29.574467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1318/2655] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:28:29.575649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f03446-62db-4bd0-a0cf-ec4d86592c7e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:29.587332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f03446-62db-4bd0-a0cf-ec4d86592c7e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:29.594018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42786946-fc7c-4d46-8197-8c21fd03b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:29.594660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42786946-fc7c-4d46-8197-8c21fd03b332 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.594939 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42786946-fc7c-4d46-8197-8c21fd03b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.595211 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42786946-fc7c-4d46-8197-8c21fd03b332 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.595899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42786946-fc7c-4d46-8197-8c21fd03b332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:29.598557 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42786946-fc7c-4d46-8197-8c21fd03b332 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:29.644439 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1338/2656] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:29 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:28:29.645685 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44845a-fc59-4ef6-ab8a-eda456ed9aea admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:29.656841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44845a-fc59-4ef6-ab8a-eda456ed9aea admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:29.724791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935ed16-e9e9-4d29-a953-e95cc5307207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:29.725668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ed16-e9e9-4d29-a953-e95cc5307207 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.725999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ed16-e9e9-4d29-a953-e95cc5307207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.726351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ed16-e9e9-4d29-a953-e95cc5307207 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.727243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935ed16-e9e9-4d29-a953-e95cc5307207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:29.727243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935ed16-e9e9-4d29-a953-e95cc5307207 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:29.766419 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1319/2657] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:29 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:29.770378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42786946-fc7c-4d46-8197-8c21fd03b332 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:29.782714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca17fc-5cc8-440b-9b57-00833d243637 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.783612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca17fc-5cc8-440b-9b57-00833d243637 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.784373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca17fc-5cc8-440b-9b57-00833d243637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.786713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42786946-fc7c-4d46-8197-8c21fd03b332 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:29.792717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80561f-08eb-4913-997a-56dc8d8298fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:29.793346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80561f-08eb-4913-997a-56dc8d8298fd admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.793622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80561f-08eb-4913-997a-56dc8d8298fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.793910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80561f-08eb-4913-997a-56dc8d8298fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.794561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80561f-08eb-4913-997a-56dc8d8298fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:29.796556 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80561f-08eb-4913-997a-56dc8d8298fd admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:29.808041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1339/2658] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:29.812164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80561f-08eb-4913-997a-56dc8d8298fd admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:29.815237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-07ca17fc-5cc8-440b-9b57-00833d243637 None None] MFA Rules not processed for user `4c310b330d8c43e987dcd29193042c87`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:29.816742 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-07ca17fc-5cc8-440b-9b57-00833d243637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:29.825034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80561f-08eb-4913-997a-56dc8d8298fd admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:29.829803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7af013-2bb8-48f3-a0c8-12a3917a0af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:29.830382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7af013-2bb8-48f3-a0c8-12a3917a0af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.830657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7af013-2bb8-48f3-a0c8-12a3917a0af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.830967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7af013-2bb8-48f3-a0c8-12a3917a0af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.831771 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7af013-2bb8-48f3-a0c8-12a3917a0af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:29.833372 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7af013-2bb8-48f3-a0c8-12a3917a0af7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:29.847838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1340/2659] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:29.848963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7af013-2bb8-48f3-a0c8-12a3917a0af7 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:29.863172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7af013-2bb8-48f3-a0c8-12a3917a0af7 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:29.869328 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5626ba-9576-4f05-b70d-4233d476b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:29.870083 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5626ba-9576-4f05-b70d-4233d476b4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.870368 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5626ba-9576-4f05-b70d-4233d476b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.872068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5626ba-9576-4f05-b70d-4233d476b4bb admin admin] PATH_INFO: `/v3/projects/c2eeec7f0cfe44ba89d1af0a6c5620be/users/0be8fd9b6af047e0af47844f642c6dc2/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.889009 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5626ba-9576-4f05-b70d-4233d476b4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2eeec7f0cfe44ba89d1af0a6c5620be, user_id=0be8fd9b6af047e0af47844f642c6dc2, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:29.891805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5626ba-9576-4f05-b70d-4233d476b4bb admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:29.907303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1320/2660] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:29.909676 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1341/2661] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:29 2022] PUT /identity/v3/projects/c2eeec7f0cfe44ba89d1af0a6c5620be/users/0be8fd9b6af047e0af47844f642c6dc2/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:29.916885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98373447-48db-41c5-89b5-c54daf9cf93b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:29.917172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98373447-48db-41c5-89b5-c54daf9cf93b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:29.917549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98373447-48db-41c5-89b5-c54daf9cf93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:29.921742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5626ba-9576-4f05-b70d-4233d476b4bb admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:29.924321 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8a5626ba-9576-4f05-b70d-4233d476b4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:29.940687 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-98373447-48db-41c5-89b5-c54daf9cf93b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:29.941924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-98373447-48db-41c5-89b5-c54daf9cf93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:29.975365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:30.008790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5626ba-9576-4f05-b70d-4233d476b4bb admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:30.010493 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1321/2662] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:30.014585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08405c-83b6-49d3-bdbe-b34a1c3217d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:30.015201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08405c-83b6-49d3-bdbe-b34a1c3217d7 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:30.015543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08405c-83b6-49d3-bdbe-b34a1c3217d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:30.015822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08405c-83b6-49d3-bdbe-b34a1c3217d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:30.020282 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98373447-48db-41c5-89b5-c54daf9cf93b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:30.021749 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-98373447-48db-41c5-89b5-c54daf9cf93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:30.075999 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08405c-83b6-49d3-bdbe-b34a1c3217d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:30.077676 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08405c-83b6-49d3-bdbe-b34a1c3217d7 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:30.081903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:30.099667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1342/2663] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:30.100821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98373447-48db-41c5-89b5-c54daf9cf93b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:30.105257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72781ffc-1960-40ee-81cf-f099b1e6aefb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:30.105959 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72781ffc-1960-40ee-81cf-f099b1e6aefb service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:30.106311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72781ffc-1960-40ee-81cf-f099b1e6aefb service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:30.107149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72781ffc-1960-40ee-81cf-f099b1e6aefb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:30.117731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72781ffc-1960-40ee-81cf-f099b1e6aefb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:30.119243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72781ffc-1960-40ee-81cf-f099b1e6aefb service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:30.129871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1322/2664] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:31.640147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14197a-36b9-459d-b2ac-3f7163968a1e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:31.640679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14197a-36b9-459d-b2ac-3f7163968a1e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:31.640776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14197a-36b9-459d-b2ac-3f7163968a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:31.671461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3e14197a-36b9-459d-b2ac-3f7163968a1e None None] MFA Rules not processed for user `4c310b330d8c43e987dcd29193042c87`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:31.672776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3e14197a-36b9-459d-b2ac-3f7163968a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:31.689583 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1343/2665] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:36.284318 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2025cd-4b32-43dd-bfb5-6ab036821f6b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:36.284779 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2025cd-4b32-43dd-bfb5-6ab036821f6b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:36.285078 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2025cd-4b32-43dd-bfb5-6ab036821f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:36.329599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1f2025cd-4b32-43dd-bfb5-6ab036821f6b None None] MFA Rules not processed for user `0be8fd9b6af047e0af47844f642c6dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:36.330824 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1f2025cd-4b32-43dd-bfb5-6ab036821f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:36.435412 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1323/2666] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:36.437917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14197a-36b9-459d-b2ac-3f7163968a1e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:36.455506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14197a-36b9-459d-b2ac-3f7163968a1e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:36.464832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5d52-613f-4960-b53d-a87771416d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:36.465750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5d52-613f-4960-b53d-a87771416d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:36.466259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5d52-613f-4960-b53d-a87771416d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:36.466987 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5d52-613f-4960-b53d-a87771416d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:36.467833 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed5d52-613f-4960-b53d-a87771416d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:36.470132 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed5d52-613f-4960-b53d-a87771416d83 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:36.503596 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1344/2667] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:36 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:28:36.508113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2025cd-4b32-43dd-bfb5-6ab036821f6b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:36.520168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2025cd-4b32-43dd-bfb5-6ab036821f6b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:36.610035 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54ce8-5d03-4448-b266-0ecaba794b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:36.610815 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54ce8-5d03-4448-b266-0ecaba794b5f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:36.610936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54ce8-5d03-4448-b266-0ecaba794b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:36.611200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54ce8-5d03-4448-b266-0ecaba794b5f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:36.612889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e54ce8-5d03-4448-b266-0ecaba794b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:36.614851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e54ce8-5d03-4448-b266-0ecaba794b5f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:36.627314 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:36.642243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1324/2668] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:36 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:36.645931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5d52-613f-4960-b53d-a87771416d83 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:36.657786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5d52-613f-4960-b53d-a87771416d83 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:36.662917 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f075921-4da4-44d8-929e-7db779082b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:36.663668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f075921-4da4-44d8-929e-7db779082b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:36.663970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f075921-4da4-44d8-929e-7db779082b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:36.664249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f075921-4da4-44d8-929e-7db779082b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:36.664902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f075921-4da4-44d8-929e-7db779082b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:36.666519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f075921-4da4-44d8-929e-7db779082b0c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:36.677465 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1345/2669] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:28:36.684361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54ce8-5d03-4448-b266-0ecaba794b5f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:36.695458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54ce8-5d03-4448-b266-0ecaba794b5f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:36.700893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a07519-52ae-47f0-9dad-070139cbd9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:36.701571 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a07519-52ae-47f0-9dad-070139cbd9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:36.701848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a07519-52ae-47f0-9dad-070139cbd9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:36.702119 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a07519-52ae-47f0-9dad-070139cbd9dc admin admin] PATH_INFO: `/v3/projects/ae9e2aa4bcdd44d9b4dd89423b64c7b1/users/84a7aed1e4c04f43af1d6f1759cdb48a/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:36.719640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a07519-52ae-47f0-9dad-070139cbd9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9e2aa4bcdd44d9b4dd89423b64c7b1, user_id=84a7aed1e4c04f43af1d6f1759cdb48a, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:36.722390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a07519-52ae-47f0-9dad-070139cbd9dc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:36.739533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1325/2670] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:36 2022] PUT /identity/v3/projects/ae9e2aa4bcdd44d9b4dd89423b64c7b1/users/84a7aed1e4c04f43af1d6f1759cdb48a/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:36.743784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f075921-4da4-44d8-929e-7db779082b0c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:36.759402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f075921-4da4-44d8-929e-7db779082b0c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:36.817745 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e882245-5e20-46ad-ab0b-43be1ac1c94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:36.818362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882245-5e20-46ad-ab0b-43be1ac1c94a admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:36.818637 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882245-5e20-46ad-ab0b-43be1ac1c94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:36.818905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882245-5e20-46ad-ab0b-43be1ac1c94a admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:36.819998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e882245-5e20-46ad-ab0b-43be1ac1c94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:36.821220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e882245-5e20-46ad-ab0b-43be1ac1c94a admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:36.832628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1346/2671] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:36.836672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a07519-52ae-47f0-9dad-070139cbd9dc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:36.848820 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a07519-52ae-47f0-9dad-070139cbd9dc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:36.853836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09609cf4-5ced-43c1-8bc0-89a95a6ca009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:36.854501 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09609cf4-5ced-43c1-8bc0-89a95a6ca009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:36.854777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09609cf4-5ced-43c1-8bc0-89a95a6ca009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:36.855048 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09609cf4-5ced-43c1-8bc0-89a95a6ca009 admin admin] PATH_INFO: `/v3/projects/ae9e2aa4bcdd44d9b4dd89423b64c7b1/users/84a7aed1e4c04f43af1d6f1759cdb48a/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:36.857025 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09609cf4-5ced-43c1-8bc0-89a95a6ca009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9e2aa4bcdd44d9b4dd89423b64c7b1, user_id=84a7aed1e4c04f43af1d6f1759cdb48a, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:36.859716 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09609cf4-5ced-43c1-8bc0-89a95a6ca009 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:36.871409 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1326/2672] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:36 2022] PUT /identity/v3/projects/ae9e2aa4bcdd44d9b4dd89423b64c7b1/users/84a7aed1e4c04f43af1d6f1759cdb48a/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:41.973878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61d926-3c5f-441a-8d1f-768c5c3a8162 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:41.974324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61d926-3c5f-441a-8d1f-768c5c3a8162 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:41.974498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61d926-3c5f-441a-8d1f-768c5c3a8162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:42.021823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6c61d926-3c5f-441a-8d1f-768c5c3a8162 None None] MFA Rules not processed for user `84a7aed1e4c04f43af1d6f1759cdb48a`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:42.023466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6c61d926-3c5f-441a-8d1f-768c5c3a8162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:42.131135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1347/2673] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:42.173332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09609cf4-5ced-43c1-8bc0-89a95a6ca009 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:42.175591 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-09609cf4-5ced-43c1-8bc0-89a95a6ca009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:42.294238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09609cf4-5ced-43c1-8bc0-89a95a6ca009 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:42.301700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34ee70-28fb-47f7-a3d2-7c93d0e72faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:42.302331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34ee70-28fb-47f7-a3d2-7c93d0e72faf service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:42.302607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34ee70-28fb-47f7-a3d2-7c93d0e72faf service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:42.302877 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34ee70-28fb-47f7-a3d2-7c93d0e72faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:42.386590 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34ee70-28fb-47f7-a3d2-7c93d0e72faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:42.388299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34ee70-28fb-47f7-a3d2-7c93d0e72faf service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:42.398695 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1327/2674] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:43.660806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0f2c-f1c1-47d7-aa5b-1bc51764938e None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:43.661634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0f2c-f1c1-47d7-aa5b-1bc51764938e None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:43.662058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0f2c-f1c1-47d7-aa5b-1bc51764938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:43.689975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-d7db0f2c-f1c1-47d7-aa5b-1bc51764938e None None] MFA Rules not processed for user `0be8fd9b6af047e0af47844f642c6dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:43.691389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d7db0f2c-f1c1-47d7-aa5b-1bc51764938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:43.699208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1348/2675] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:44.032445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34ee70-28fb-47f7-a3d2-7c93d0e72faf service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:44.051316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34ee70-28fb-47f7-a3d2-7c93d0e72faf service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:44.059839 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555ed7-1b58-4a24-8032-3b656e93aaaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:44.060975 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555ed7-1b58-4a24-8032-3b656e93aaaa service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:44.061254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555ed7-1b58-4a24-8032-3b656e93aaaa service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:44.061527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555ed7-1b58-4a24-8032-3b656e93aaaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:44.063424 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-60555ed7-1b58-4a24-8032-3b656e93aaaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:44.095301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555ed7-1b58-4a24-8032-3b656e93aaaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:44.097275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555ed7-1b58-4a24-8032-3b656e93aaaa service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:44.111962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1328/2676] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:50.317376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0f2c-f1c1-47d7-aa5b-1bc51764938e None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:50.318981 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d7db0f2c-f1c1-47d7-aa5b-1bc51764938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:50.357423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:50.380840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0f2c-f1c1-47d7-aa5b-1bc51764938e None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:50.384886 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360e841-090b-4b98-902a-9780f8402958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:50.385495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e841-090b-4b98-902a-9780f8402958 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:50.385769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e841-090b-4b98-902a-9780f8402958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:50.386040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e841-090b-4b98-902a-9780f8402958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:50.388021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c360e841-090b-4b98-902a-9780f8402958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:50.463544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360e841-090b-4b98-902a-9780f8402958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:50.465111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360e841-090b-4b98-902a-9780f8402958 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:50.477487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1349/2677] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:53.467115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555ed7-1b58-4a24-8032-3b656e93aaaa service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:53.469684 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-60555ed7-1b58-4a24-8032-3b656e93aaaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:53.526120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:53.539717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360e841-090b-4b98-902a-9780f8402958 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:53.541503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c360e841-090b-4b98-902a-9780f8402958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:53.556152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360e841-090b-4b98-902a-9780f8402958 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:53.561591 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:53.562380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:53.562717 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:53.563038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] PATH_INFO: `/v3/users/9c6321d3fb5d4265aaff699fae301ed4` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:53.564212 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6321d3fb5d4265aaff699fae301ed4)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:53.566179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:53.573141 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555ed7-1b58-4a24-8032-3b656e93aaaa service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:53.579370 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ec0a8-2b7b-41a8-b7f9-558a9a3935bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:53.580015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ec0a8-2b7b-41a8-b7f9-558a9a3935bb service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:53.580300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ec0a8-2b7b-41a8-b7f9-558a9a3935bb service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:53.580574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ec0a8-2b7b-41a8-b7f9-558a9a3935bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:53.582957 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b6ec0a8-2b7b-41a8-b7f9-558a9a3935bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:53.600130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ec0a8-2b7b-41a8-b7f9-558a9a3935bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:53.601758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ec0a8-2b7b-41a8-b7f9-558a9a3935bb service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:53.617986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1329/2678] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:53.632220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6321d3fb5d4265aaff699fae301ed4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:53.649019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6321d3fb5d4265aaff699fae301ed4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:53.658294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6321d3fb5d4265aaff699fae301ed4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:53.658953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6321d3fb5d4265aaff699fae301ed4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:53.659600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-df61a159-6d52-4759-a99b-e23ee6ce5683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6321d3fb5d4265aaff699fae301ed4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:53.673798 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1350/2679] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:53 2022] DELETE /identity/v3/users/9c6321d3fb5d4265aaff699fae301ed4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:53.847621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ec0a8-2b7b-41a8-b7f9-558a9a3935bb service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:53.860432 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ec0a8-2b7b-41a8-b7f9-558a9a3935bb service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:53.920561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:53.921202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:53.921481 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:53.921752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] PATH_INFO: `/v3/projects/4ff356ac6962437c9662f12e8877d409` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:53.922886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff356ac6962437c9662f12e8877d409)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:53.924840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:53.984377 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff356ac6962437c9662f12e8877d409', 'request_id': 'req-66bd0510-9c4d-4836-8016-9b928ce8a0b3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:53.994443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff356ac6962437c9662f12e8877d409', 'request_id': 'req-66bd0510-9c4d-4836-8016-9b928ce8a0b3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:54.001457 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff356ac6962437c9662f12e8877d409', 'request_id': 'req-66bd0510-9c4d-4836-8016-9b928ce8a0b3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:54.013906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] The token cache is being invalidate because project 4ff356ac6962437c9662f12e8877d409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:54.014228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:54.015014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66bd0510-9c4d-4836-8016-9b928ce8a0b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:54.016655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1330/2680] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:53 2022] DELETE /identity/v3/projects/4ff356ac6962437c9662f12e8877d409 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:54.021692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23dd44-4e8d-4570-af98-82419c59c398 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.021979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23dd44-4e8d-4570-af98-82419c59c398 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.022251 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23dd44-4e8d-4570-af98-82419c59c398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.044896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8d23dd44-4e8d-4570-af98-82419c59c398 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:54.046109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8d23dd44-4e8d-4570-af98-82419c59c398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:54.094748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:54.107012 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1351/2681] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:54.116223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e66255-53b9-4feb-90de-af8718735dc2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.116502 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e66255-53b9-4feb-90de-af8718735dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.116775 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e66255-53b9-4feb-90de-af8718735dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.146499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f2e66255-53b9-4feb-90de-af8718735dc2 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:54.147809 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f2e66255-53b9-4feb-90de-af8718735dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:54.160008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1331/2682] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:54.165071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23dd44-4e8d-4570-af98-82419c59c398 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.178246 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23dd44-4e8d-4570-af98-82419c59c398 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.184615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db763c22-b49f-4c8c-8aaf-a293411b2da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:54.185457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db763c22-b49f-4c8c-8aaf-a293411b2da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.185825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db763c22-b49f-4c8c-8aaf-a293411b2da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.186137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db763c22-b49f-4c8c-8aaf-a293411b2da8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.187040 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db763c22-b49f-4c8c-8aaf-a293411b2da8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:28:54.187458 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db763c22-b49f-4c8c-8aaf-a293411b2da8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:54.189445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db763c22-b49f-4c8c-8aaf-a293411b2da8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:54.203041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1352/2683] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:28:54.207868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e66255-53b9-4feb-90de-af8718735dc2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.218394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e66255-53b9-4feb-90de-af8718735dc2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.224159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7b5a3-9283-4473-8661-906c6d53ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:54.224766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7b5a3-9283-4473-8661-906c6d53ec38 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.225049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7b5a3-9283-4473-8661-906c6d53ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.225319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7b5a3-9283-4473-8661-906c6d53ec38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.225953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7b5a3-9283-4473-8661-906c6d53ec38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:54.228203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7b5a3-9283-4473-8661-906c6d53ec38 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:54.263844 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1332/2684] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:54 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:54.268197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db763c22-b49f-4c8c-8aaf-a293411b2da8 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.278843 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db763c22-b49f-4c8c-8aaf-a293411b2da8 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.335802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ca26-9c13-4c20-832d-c66cab07e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:54.336421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ca26-9c13-4c20-832d-c66cab07e932 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.336836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ca26-9c13-4c20-832d-c66cab07e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.337172 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ca26-9c13-4c20-832d-c66cab07e932 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.337795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8ca26-9c13-4c20-832d-c66cab07e932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:54.339724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8ca26-9c13-4c20-832d-c66cab07e932 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:54.364872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1353/2685] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:54 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:54.369241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7b5a3-9283-4473-8661-906c6d53ec38 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.381435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7b5a3-9283-4473-8661-906c6d53ec38 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.387543 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ca53-bc6f-48f4-8c44-54a45a065f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:54.388162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ca53-bc6f-48f4-8c44-54a45a065f3d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.388442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ca53-bc6f-48f4-8c44-54a45a065f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.388713 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ca53-bc6f-48f4-8c44-54a45a065f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.389397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18ca53-bc6f-48f4-8c44-54a45a065f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:54.391010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18ca53-bc6f-48f4-8c44-54a45a065f3d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:54.401955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1333/2686] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:54.406250 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ca26-9c13-4c20-832d-c66cab07e932 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.416989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ca26-9c13-4c20-832d-c66cab07e932 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.422164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2805d3c-8379-4e19-bf0b-33f9e4604cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:54.422772 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2805d3c-8379-4e19-bf0b-33f9e4604cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.423050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2805d3c-8379-4e19-bf0b-33f9e4604cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.423353 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2805d3c-8379-4e19-bf0b-33f9e4604cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.423995 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2805d3c-8379-4e19-bf0b-33f9e4604cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:54.425645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2805d3c-8379-4e19-bf0b-33f9e4604cd0 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:54.438452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1354/2687] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:54.442946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ca53-bc6f-48f4-8c44-54a45a065f3d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.453299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ca53-bc6f-48f4-8c44-54a45a065f3d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.457932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb072d3-c98e-437e-8c53-e3be16509c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:54.458576 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb072d3-c98e-437e-8c53-e3be16509c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.458852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb072d3-c98e-437e-8c53-e3be16509c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.459121 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb072d3-c98e-437e-8c53-e3be16509c8e admin admin] PATH_INFO: `/v3/projects/1e6383f2fa274dd0aaeb9b6d382734ae/users/0925e4c883c545308f34c82d2ab30541/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.476654 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb072d3-c98e-437e-8c53-e3be16509c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6383f2fa274dd0aaeb9b6d382734ae, user_id=0925e4c883c545308f34c82d2ab30541, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:54.480921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb072d3-c98e-437e-8c53-e3be16509c8e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:54.494671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:54.501152 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1334/2688] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:54 2022] PUT /identity/v3/projects/1e6383f2fa274dd0aaeb9b6d382734ae/users/0925e4c883c545308f34c82d2ab30541/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:28:54.512384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c8da-5592-4d3e-91d9-5f59b39766e3 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.512673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c8da-5592-4d3e-91d9-5f59b39766e3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.512954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c8da-5592-4d3e-91d9-5f59b39766e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.541571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6096c8da-5592-4d3e-91d9-5f59b39766e3 None None] MFA Rules not processed for user `0925e4c883c545308f34c82d2ab30541`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:54.542762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6096c8da-5592-4d3e-91d9-5f59b39766e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:54.609405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1355/2689] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:54.614164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb072d3-c98e-437e-8c53-e3be16509c8e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.686647 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb072d3-c98e-437e-8c53-e3be16509c8e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.692562 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179abd1-f28b-4124-b3bf-9483e48f9aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:54.693270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179abd1-f28b-4124-b3bf-9483e48f9aec admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.693629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179abd1-f28b-4124-b3bf-9483e48f9aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.693898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179abd1-f28b-4124-b3bf-9483e48f9aec admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.694527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179abd1-f28b-4124-b3bf-9483e48f9aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:54.696577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179abd1-f28b-4124-b3bf-9483e48f9aec admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:54.727707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1335/2690] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:54 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:54.732081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096c8da-5592-4d3e-91d9-5f59b39766e3 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.744351 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096c8da-5592-4d3e-91d9-5f59b39766e3 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.790665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:54.802639 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70daa3-f3ab-4829-9bd9-a2b0a80d6025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:54.803311 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70daa3-f3ab-4829-9bd9-a2b0a80d6025 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.803599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70daa3-f3ab-4829-9bd9-a2b0a80d6025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.803877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70daa3-f3ab-4829-9bd9-a2b0a80d6025 admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.804549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70daa3-f3ab-4829-9bd9-a2b0a80d6025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:54.806704 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70daa3-f3ab-4829-9bd9-a2b0a80d6025 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:54.830274 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1356/2691] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:54 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:28:54.834541 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179abd1-f28b-4124-b3bf-9483e48f9aec admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.846783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179abd1-f28b-4124-b3bf-9483e48f9aec admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.852403 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e5db-1452-4c80-b3b3-3b3597cd85cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:54.853015 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e5db-1452-4c80-b3b3-3b3597cd85cb admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.853298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e5db-1452-4c80-b3b3-3b3597cd85cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.853575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e5db-1452-4c80-b3b3-3b3597cd85cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.854230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930e5db-1452-4c80-b3b3-3b3597cd85cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:54.855878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930e5db-1452-4c80-b3b3-3b3597cd85cb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:54.867568 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1336/2692] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:28:54.872397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70daa3-f3ab-4829-9bd9-a2b0a80d6025 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.883547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70daa3-f3ab-4829-9bd9-a2b0a80d6025 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.889986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0b020-f044-4da6-943a-d45157c99af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:54.890643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0b020-f044-4da6-943a-d45157c99af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:54.890921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0b020-f044-4da6-943a-d45157c99af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:54.891188 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0b020-f044-4da6-943a-d45157c99af7 admin admin] PATH_INFO: `/v3/projects/f033132a93c64cc69f8cf6e5be9fdf38/users/cae24c1893654329b26c2dfce76e2c82/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:54.907084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0b020-f044-4da6-943a-d45157c99af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f033132a93c64cc69f8cf6e5be9fdf38, user_id=cae24c1893654329b26c2dfce76e2c82, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:54.909866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0b020-f044-4da6-943a-d45157c99af7 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:54.925764 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1357/2693] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:54 2022] PUT /identity/v3/projects/f033132a93c64cc69f8cf6e5be9fdf38/users/cae24c1893654329b26c2dfce76e2c82/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:54.929942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e5db-1452-4c80-b3b3-3b3597cd85cb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:54.940837 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e5db-1452-4c80-b3b3-3b3597cd85cb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:54.999829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c19b28-70e1-4dc5-9acf-6518898d9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:55.000589 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c19b28-70e1-4dc5-9acf-6518898d9dce admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:55.000960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c19b28-70e1-4dc5-9acf-6518898d9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:55.001427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c19b28-70e1-4dc5-9acf-6518898d9dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:55.002242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c19b28-70e1-4dc5-9acf-6518898d9dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:55.003939 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c19b28-70e1-4dc5-9acf-6518898d9dce admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:55.014316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1337/2694] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:55.018621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0b020-f044-4da6-943a-d45157c99af7 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:55.029616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0b020-f044-4da6-943a-d45157c99af7 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:55.034640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79632b-7385-4090-b714-31d4bcd379a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:55.035453 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79632b-7385-4090-b714-31d4bcd379a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:55.035738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79632b-7385-4090-b714-31d4bcd379a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:55.036029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79632b-7385-4090-b714-31d4bcd379a0 admin admin] PATH_INFO: `/v3/projects/f033132a93c64cc69f8cf6e5be9fdf38/users/cae24c1893654329b26c2dfce76e2c82/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:55.037970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79632b-7385-4090-b714-31d4bcd379a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f033132a93c64cc69f8cf6e5be9fdf38, user_id=cae24c1893654329b26c2dfce76e2c82, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:55.040966 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79632b-7385-4090-b714-31d4bcd379a0 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:55.051190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1358/2695] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:55 2022] PUT /identity/v3/projects/f033132a93c64cc69f8cf6e5be9fdf38/users/cae24c1893654329b26c2dfce76e2c82/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:55.063242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ff8f4-4c67-45f8-823d-a41019ebfa38 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:55.063542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ff8f4-4c67-45f8-823d-a41019ebfa38 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:55.063812 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ff8f4-4c67-45f8-823d-a41019ebfa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:55.091726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-265ff8f4-4c67-45f8-823d-a41019ebfa38 None None] MFA Rules not processed for user `cae24c1893654329b26c2dfce76e2c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:55.092921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-265ff8f4-4c67-45f8-823d-a41019ebfa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:55.154067 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:55.166148 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1338/2696] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:55.177788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79632b-7385-4090-b714-31d4bcd379a0 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:55.179825 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4e79632b-7385-4090-b714-31d4bcd379a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:55.239851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79632b-7385-4090-b714-31d4bcd379a0 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:55.244302 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52f0cd-83d4-4cc8-b462-a630fb943b1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:55.244902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f0cd-83d4-4cc8-b462-a630fb943b1d service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:55.245178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f0cd-83d4-4cc8-b462-a630fb943b1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:55.245446 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f0cd-83d4-4cc8-b462-a630fb943b1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:55.254651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52f0cd-83d4-4cc8-b462-a630fb943b1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:55.256119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52f0cd-83d4-4cc8-b462-a630fb943b1d service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:55.265521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1359/2697] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:55.335245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ff8f4-4c67-45f8-823d-a41019ebfa38 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:55.401646 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ff8f4-4c67-45f8-823d-a41019ebfa38 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:55.409467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:55.410398 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:55.410756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:55.411053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] PATH_INFO: `/v3/users/0925e4c883c545308f34c82d2ab30541` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:55.412930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0925e4c883c545308f34c82d2ab30541)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:55.415955 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:55.473757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0925e4c883c545308f34c82d2ab30541'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:55.485552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0925e4c883c545308f34c82d2ab30541'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:55.492538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0925e4c883c545308f34c82d2ab30541'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:55.493225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0925e4c883c545308f34c82d2ab30541'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:55.494024 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0925e4c883c545308f34c82d2ab30541'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:55.509431 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1339/2698] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:55 2022] DELETE /identity/v3/users/0925e4c883c545308f34c82d2ab30541 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:55.514103 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045262e6-e0d3-4b66-9097-c6d482b58b06 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:55.514385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045262e6-e0d3-4b66-9097-c6d482b58b06 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:55.514661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045262e6-e0d3-4b66-9097-c6d482b58b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:55.533769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-045262e6-e0d3-4b66-9097-c6d482b58b06 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:55.534982 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-045262e6-e0d3-4b66-9097-c6d482b58b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:55.595148 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1360/2699] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:55.605332 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:55.606825 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:55.667785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d85dfa-2817-4594-8e3a-d6c3ce8d8414 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:55.671929 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761afec2-0a65-4594-9d3f-15078a246b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:55.672559 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761afec2-0a65-4594-9d3f-15078a246b62 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:55.672845 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761afec2-0a65-4594-9d3f-15078a246b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:55.673121 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761afec2-0a65-4594-9d3f-15078a246b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:55.682360 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761afec2-0a65-4594-9d3f-15078a246b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:55.683923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761afec2-0a65-4594-9d3f-15078a246b62 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:55.695074 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1340/2700] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:55.997180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045262e6-e0d3-4b66-9097-c6d482b58b06 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:55.999376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-045262e6-e0d3-4b66-9097-c6d482b58b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:56.013451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045262e6-e0d3-4b66-9097-c6d482b58b06 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:56.021532 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:56.023033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:56.023429 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:56.023703 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] PATH_INFO: `/v3/projects/1e6383f2fa274dd0aaeb9b6d382734ae` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:56.025946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6383f2fa274dd0aaeb9b6d382734ae)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:56.030373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:56.080784 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:56.087759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6383f2fa274dd0aaeb9b6d382734ae', 'request_id': 'req-32b0c3fe-1d5a-4ca8-a5e6-006732209524'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.096171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6383f2fa274dd0aaeb9b6d382734ae', 'request_id': 'req-32b0c3fe-1d5a-4ca8-a5e6-006732209524'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.102487 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6383f2fa274dd0aaeb9b6d382734ae', 'request_id': 'req-32b0c3fe-1d5a-4ca8-a5e6-006732209524'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.114213 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] The token cache is being invalidate because project 1e6383f2fa274dd0aaeb9b6d382734ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:56.114524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.115189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.116840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1361/2701] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:55 2022] DELETE /identity/v3/projects/1e6383f2fa274dd0aaeb9b6d382734ae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:56.121700 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761afec2-0a65-4594-9d3f-15078a246b62 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:56.131577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761afec2-0a65-4594-9d3f-15078a246b62 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:56.143504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:56.190351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:56.190993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:56.191275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:56.191588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] PATH_INFO: `/v3/users/cae24c1893654329b26c2dfce76e2c82` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:56.192757 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae24c1893654329b26c2dfce76e2c82)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:56.194708 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:56.248597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae24c1893654329b26c2dfce76e2c82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.260607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae24c1893654329b26c2dfce76e2c82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.267551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae24c1893654329b26c2dfce76e2c82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.268287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae24c1893654329b26c2dfce76e2c82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.268973 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b7f31038-e698-4fd5-96f7-d96d2fa0cca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae24c1893654329b26c2dfce76e2c82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.285279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1341/2702] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:28:56 2022] DELETE /identity/v3/users/cae24c1893654329b26c2dfce76e2c82 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:56.565017 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:56.566675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:56.581342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0c3fe-1d5a-4ca8-a5e6-006732209524 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:56.639605 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:56.640315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:56.640503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:56.640774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] PATH_INFO: `/v3/projects/f033132a93c64cc69f8cf6e5be9fdf38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:56.641868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f033132a93c64cc69f8cf6e5be9fdf38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:56.643822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:56.697638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f033132a93c64cc69f8cf6e5be9fdf38', 'request_id': 'req-e76d6de7-19b1-448a-a506-7ecd80cc4655'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.707498 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f033132a93c64cc69f8cf6e5be9fdf38', 'request_id': 'req-e76d6de7-19b1-448a-a506-7ecd80cc4655'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.713721 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f033132a93c64cc69f8cf6e5be9fdf38', 'request_id': 'req-e76d6de7-19b1-448a-a506-7ecd80cc4655'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.724261 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] The token cache is being invalidate because project f033132a93c64cc69f8cf6e5be9fdf38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:28:56.724540 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.725167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e76d6de7-19b1-448a-a506-7ecd80cc4655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:28:56.726623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1362/2703] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:28:56 2022] DELETE /identity/v3/projects/f033132a93c64cc69f8cf6e5be9fdf38 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:56.731753 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2b82b-f901-4117-92f1-a390fa8e5590 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:56.732230 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2b82b-f901-4117-92f1-a390fa8e5590 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:56.732343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2b82b-f901-4117-92f1-a390fa8e5590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:56.752739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-90f2b82b-f901-4117-92f1-a390fa8e5590 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:56.753961 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-90f2b82b-f901-4117-92f1-a390fa8e5590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:56.816931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1342/2704] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:56.824851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126edb-dfe8-4382-803c-c6ff2443ea8f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:56.825135 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126edb-dfe8-4382-803c-c6ff2443ea8f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:56.825403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126edb-dfe8-4382-803c-c6ff2443ea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:56.847014 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-84126edb-dfe8-4382-803c-c6ff2443ea8f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:56.848267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-84126edb-dfe8-4382-803c-c6ff2443ea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:56.857396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1363/2705] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:56.861881 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2b82b-f901-4117-92f1-a390fa8e5590 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:56.872196 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2b82b-f901-4117-92f1-a390fa8e5590 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:56.877650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9363c4-a463-4946-b1c1-4ae0554ab96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:56.878259 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9363c4-a463-4946-b1c1-4ae0554ab96a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:56.878538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9363c4-a463-4946-b1c1-4ae0554ab96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:56.878778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9363c4-a463-4946-b1c1-4ae0554ab96a admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:56.879496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9363c4-a463-4946-b1c1-4ae0554ab96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:28:56.879800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9363c4-a463-4946-b1c1-4ae0554ab96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:56.881401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9363c4-a463-4946-b1c1-4ae0554ab96a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:56.893128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1343/2706] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:28:56.897452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126edb-dfe8-4382-803c-c6ff2443ea8f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:56.907705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126edb-dfe8-4382-803c-c6ff2443ea8f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:56.912926 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942a111-ceaf-4c21-a533-16ff758af239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:56.913520 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942a111-ceaf-4c21-a533-16ff758af239 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:56.913786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942a111-ceaf-4c21-a533-16ff758af239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:56.914063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942a111-ceaf-4c21-a533-16ff758af239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:56.914685 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942a111-ceaf-4c21-a533-16ff758af239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:56.916644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942a111-ceaf-4c21-a533-16ff758af239 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:56.946869 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1364/2707] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:28:56 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:56.951083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9363c4-a463-4946-b1c1-4ae0554ab96a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:56.961273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9363c4-a463-4946-b1c1-4ae0554ab96a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:56.981210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:57.022278 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819ef7d-7031-496e-9b1e-65ab271ae091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:57.022889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819ef7d-7031-496e-9b1e-65ab271ae091 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:57.023194 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819ef7d-7031-496e-9b1e-65ab271ae091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:57.023503 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819ef7d-7031-496e-9b1e-65ab271ae091 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:57.024155 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819ef7d-7031-496e-9b1e-65ab271ae091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:57.026162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819ef7d-7031-496e-9b1e-65ab271ae091 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:57.050666 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1344/2708] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:28:56 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:28:57.054967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942a111-ceaf-4c21-a533-16ff758af239 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:57.065628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942a111-ceaf-4c21-a533-16ff758af239 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:57.070820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998153db-2ebb-48a4-9ead-fefc96948d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:57.071549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998153db-2ebb-48a4-9ead-fefc96948d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:57.071713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998153db-2ebb-48a4-9ead-fefc96948d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:57.071984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998153db-2ebb-48a4-9ead-fefc96948d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:57.072625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998153db-2ebb-48a4-9ead-fefc96948d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:57.074221 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998153db-2ebb-48a4-9ead-fefc96948d68 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:57.084565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1365/2709] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:28:57.088621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819ef7d-7031-496e-9b1e-65ab271ae091 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:57.099076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819ef7d-7031-496e-9b1e-65ab271ae091 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:57.104425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75893-588c-47d6-8125-08925196a084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:57.105047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75893-588c-47d6-8125-08925196a084 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:57.105326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75893-588c-47d6-8125-08925196a084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:57.105602 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75893-588c-47d6-8125-08925196a084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:57.106251 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a75893-588c-47d6-8125-08925196a084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:57.107891 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a75893-588c-47d6-8125-08925196a084 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:57.120323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1345/2710] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:28:57.126150 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998153db-2ebb-48a4-9ead-fefc96948d68 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:57.136888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998153db-2ebb-48a4-9ead-fefc96948d68 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:57.143471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3954924-571f-4613-9db7-cb82cf257f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:57.144147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3954924-571f-4613-9db7-cb82cf257f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:57.144418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3954924-571f-4613-9db7-cb82cf257f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:57.144691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3954924-571f-4613-9db7-cb82cf257f3e admin admin] PATH_INFO: `/v3/projects/592f7dd9d391462684b14f606995e45d/users/255a5c15b9f74b2e89337068c022103c/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:57.162673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3954924-571f-4613-9db7-cb82cf257f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=592f7dd9d391462684b14f606995e45d, user_id=255a5c15b9f74b2e89337068c022103c, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:57.165709 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3954924-571f-4613-9db7-cb82cf257f3e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:57.169593 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:28:57.182659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1366/2711] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:28:57 2022] PUT /identity/v3/projects/592f7dd9d391462684b14f606995e45d/users/255a5c15b9f74b2e89337068c022103c/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:28:57.193357 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb00f8-fcb3-45ea-9b6d-164302d77b82 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:57.193643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb00f8-fcb3-45ea-9b6d-164302d77b82 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:57.193917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb00f8-fcb3-45ea-9b6d-164302d77b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:57.352145 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-99fb00f8-fcb3-45ea-9b6d-164302d77b82 None None] MFA Rules not processed for user `255a5c15b9f74b2e89337068c022103c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:28:57.353821 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-99fb00f8-fcb3-45ea-9b6d-164302d77b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:57.420800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1346/2712] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:28:57.431889 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3954924-571f-4613-9db7-cb82cf257f3e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:57.433756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-a3954924-571f-4613-9db7-cb82cf257f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:57.481802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb00f8-fcb3-45ea-9b6d-164302d77b82 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:28:57.483367 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-99fb00f8-fcb3-45ea-9b6d-164302d77b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:57.492324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3954924-571f-4613-9db7-cb82cf257f3e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:57.496034 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcab46e-af4d-4f18-b9dc-37f16644e65a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54131719962e4463b0b874916cb40973', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:57.496654 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcab46e-af4d-4f18-b9dc-37f16644e65a service glance] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:57.496915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcab46e-af4d-4f18-b9dc-37f16644e65a service glance] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:57.497459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcab46e-af4d-4f18-b9dc-37f16644e65a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:57.505612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcab46e-af4d-4f18-b9dc-37f16644e65a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:57.507124 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcab46e-af4d-4f18-b9dc-37f16644e65a service glance] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:57.516706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1367/2713] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:28:57.540941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb00f8-fcb3-45ea-9b6d-164302d77b82 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:28:57.544898 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca8e67-122e-4835-bc36-5f077d88ae75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:28:57.545560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca8e67-122e-4835-bc36-5f077d88ae75 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:28:57.545763 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca8e67-122e-4835-bc36-5f077d88ae75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:28:57.546028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca8e67-122e-4835-bc36-5f077d88ae75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:28:57.547808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-35ca8e67-122e-4835-bc36-5f077d88ae75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:28:57.558479 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca8e67-122e-4835-bc36-5f077d88ae75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:28:57.559949 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca8e67-122e-4835-bc36-5f077d88ae75 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:28:57.570522 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1347/2714] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:28:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:29:07.512434 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=28 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:07.564498 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:10.022936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcab46e-af4d-4f18-b9dc-37f16644e65a service glance] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:10.032483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcab46e-af4d-4f18-b9dc-37f16644e65a service glance] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:10.036189 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fddaf-dd8a-4f25-b637-c8b6b3f3c2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:10.036783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fddaf-dd8a-4f25-b637-c8b6b3f3c2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:10.037062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fddaf-dd8a-4f25-b637-c8b6b3f3c2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:10.037331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fddaf-dd8a-4f25-b637-c8b6b3f3c2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:10.039004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1d1fddaf-dd8a-4f25-b637-c8b6b3f3c2d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:10.104226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fddaf-dd8a-4f25-b637-c8b6b3f3c2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:10.105695 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fddaf-dd8a-4f25-b637-c8b6b3f3c2d0 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:10.116315 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1368/2715] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:12.279444 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca8e67-122e-4835-bc36-5f077d88ae75 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:12.346655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca8e67-122e-4835-bc36-5f077d88ae75 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:12.351162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:12.351871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:12.352144 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:12.352425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] PATH_INFO: `/v3/users/255a5c15b9f74b2e89337068c022103c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:12.353557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255a5c15b9f74b2e89337068c022103c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:12.355475 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:12.404722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255a5c15b9f74b2e89337068c022103c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:12.417560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255a5c15b9f74b2e89337068c022103c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:12.425446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255a5c15b9f74b2e89337068c022103c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:12.426259 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255a5c15b9f74b2e89337068c022103c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:12.426888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255a5c15b9f74b2e89337068c022103c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:12.442105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1348/2716] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:29:12 2022] DELETE /identity/v3/users/255a5c15b9f74b2e89337068c022103c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:12.446965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1d75-d863-42c3-a6df-df341880be8b None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:12.447505 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1d75-d863-42c3-a6df-df341880be8b None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:12.447625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1d75-d863-42c3-a6df-df341880be8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:12.469420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-9f0f1d75-d863-42c3-a6df-df341880be8b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:12.470680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9f0f1d75-d863-42c3-a6df-df341880be8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:12.535099 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1369/2717] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:12.545490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:12.547058 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:12.607996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea20c9b-4d1e-4275-87c4-d5eab760f7d5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:12.612061 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192022c2-d8d7-4909-b70e-07f70b06412e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:12.612682 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192022c2-d8d7-4909-b70e-07f70b06412e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:12.612958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192022c2-d8d7-4909-b70e-07f70b06412e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:12.613221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192022c2-d8d7-4909-b70e-07f70b06412e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:12.623128 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192022c2-d8d7-4909-b70e-07f70b06412e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:12.624944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192022c2-d8d7-4909-b70e-07f70b06412e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:12.634913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1349/2718] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:12.914323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1d75-d863-42c3-a6df-df341880be8b None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:12.915789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9f0f1d75-d863-42c3-a6df-df341880be8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:12.934864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1d75-d863-42c3-a6df-df341880be8b None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:12.942066 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:12.942710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:12.942983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:12.943285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] PATH_INFO: `/v3/projects/592f7dd9d391462684b14f606995e45d` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:12.944500 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592f7dd9d391462684b14f606995e45d)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:12.946412 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:12.998183 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592f7dd9d391462684b14f606995e45d', 'request_id': 'req-4f46552e-d954-49b8-ad7f-f0edc8d5c844'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:13.006373 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592f7dd9d391462684b14f606995e45d', 'request_id': 'req-4f46552e-d954-49b8-ad7f-f0edc8d5c844'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:13.012609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592f7dd9d391462684b14f606995e45d', 'request_id': 'req-4f46552e-d954-49b8-ad7f-f0edc8d5c844'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:13.023088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] The token cache is being invalidate because project 592f7dd9d391462684b14f606995e45d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:29:13.023417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:13.024113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-4f46552e-d954-49b8-ad7f-f0edc8d5c844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:13.025719 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1370/2719] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:29:12 2022] DELETE /identity/v3/projects/592f7dd9d391462684b14f606995e45d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:13.030659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38151-4273-4913-853a-01944c9581c4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:13.030943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38151-4273-4913-853a-01944c9581c4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:13.031209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38151-4273-4913-853a-01944c9581c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:13.050610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3ad38151-4273-4913-853a-01944c9581c4 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:13.052040 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3ad38151-4273-4913-853a-01944c9581c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:13.069953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:13.113538 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1350/2720] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:13.123048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fda55-afdf-4a81-a2db-b9bc7e48ac84 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:13.123582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fda55-afdf-4a81-a2db-b9bc7e48ac84 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:13.123857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fda55-afdf-4a81-a2db-b9bc7e48ac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:13.144969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-b43fda55-afdf-4a81-a2db-b9bc7e48ac84 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:13.146176 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-b43fda55-afdf-4a81-a2db-b9bc7e48ac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:13.155742 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1371/2721] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:13.160683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad38151-4273-4913-853a-01944c9581c4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:13.175108 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad38151-4273-4913-853a-01944c9581c4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:13.180328 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b3e8f-5438-4174-861c-70022a420691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:13.180938 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b3e8f-5438-4174-861c-70022a420691 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:13.181216 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b3e8f-5438-4174-861c-70022a420691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:13.181489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b3e8f-5438-4174-861c-70022a420691 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:13.182147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b3e8f-5438-4174-861c-70022a420691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:29:13.182565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b3e8f-5438-4174-861c-70022a420691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:13.184906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b3e8f-5438-4174-861c-70022a420691 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:13.197466 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1351/2722] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 01:29:13.202177 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fda55-afdf-4a81-a2db-b9bc7e48ac84 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:13.211535 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fda55-afdf-4a81-a2db-b9bc7e48ac84 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:13.216853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ebda7-d309-4c8a-ad32-83797fc29fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:13.217457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ebda7-d309-4c8a-ad32-83797fc29fee admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:13.217727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ebda7-d309-4c8a-ad32-83797fc29fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:13.217996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ebda7-d309-4c8a-ad32-83797fc29fee admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:13.218612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ebda7-d309-4c8a-ad32-83797fc29fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:13.220545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ebda7-d309-4c8a-ad32-83797fc29fee admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:13.229972 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:13.251929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1372/2723] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:29:13 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:29:13.256147 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b3e8f-5438-4174-861c-70022a420691 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:13.266507 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b3e8f-5438-4174-861c-70022a420691 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:13.324758 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395635-0725-4e06-8876-4e256eb7d02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:13.325440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395635-0725-4e06-8876-4e256eb7d02f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:13.325933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395635-0725-4e06-8876-4e256eb7d02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:13.326310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395635-0725-4e06-8876-4e256eb7d02f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:13.326954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b395635-0725-4e06-8876-4e256eb7d02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:13.328907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b395635-0725-4e06-8876-4e256eb7d02f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:13.352333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1352/2724] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:29:13 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:29:13.356765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ebda7-d309-4c8a-ad32-83797fc29fee admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:13.367413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ebda7-d309-4c8a-ad32-83797fc29fee admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:13.372018 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed058f-55ff-4ebb-9507-af0c306e0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:13.372673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed058f-55ff-4ebb-9507-af0c306e0218 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:13.373026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed058f-55ff-4ebb-9507-af0c306e0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:13.373216 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed058f-55ff-4ebb-9507-af0c306e0218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:13.373853 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed058f-55ff-4ebb-9507-af0c306e0218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:13.375506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed058f-55ff-4ebb-9507-af0c306e0218 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:13.385410 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1373/2725] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:13.389575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395635-0725-4e06-8876-4e256eb7d02f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:13.400297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395635-0725-4e06-8876-4e256eb7d02f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:13.406190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf6c52-2b3a-4fc0-bec3-91d872958314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:13.406794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6c52-2b3a-4fc0-bec3-91d872958314 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:13.407074 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6c52-2b3a-4fc0-bec3-91d872958314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:13.407375 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6c52-2b3a-4fc0-bec3-91d872958314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:13.408020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf6c52-2b3a-4fc0-bec3-91d872958314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:13.409605 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf6c52-2b3a-4fc0-bec3-91d872958314 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:13.419962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1353/2726] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:13.424171 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed058f-55ff-4ebb-9507-af0c306e0218 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:13.434713 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed058f-55ff-4ebb-9507-af0c306e0218 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:13.440921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd93e47-10ff-4b30-9acd-61b2f9532bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:13.441581 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd93e47-10ff-4b30-9acd-61b2f9532bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:13.441859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd93e47-10ff-4b30-9acd-61b2f9532bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:13.442133 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd93e47-10ff-4b30-9acd-61b2f9532bb0 admin admin] PATH_INFO: `/v3/projects/58c5a0854f664c4894d0660d2b784967/users/a463f097e41844d8b5fbb31179895c4c/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:13.458075 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd93e47-10ff-4b30-9acd-61b2f9532bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c5a0854f664c4894d0660d2b784967, user_id=a463f097e41844d8b5fbb31179895c4c, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:13.460791 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd93e47-10ff-4b30-9acd-61b2f9532bb0 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:13.476979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1374/2727] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:29:13 2022] PUT /identity/v3/projects/58c5a0854f664c4894d0660d2b784967/users/a463f097e41844d8b5fbb31179895c4c/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:13.487408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024db356-30fd-49fe-aac5-5194dc1af58b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:13.487694 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024db356-30fd-49fe-aac5-5194dc1af58b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:13.487963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024db356-30fd-49fe-aac5-5194dc1af58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:13.518642 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-024db356-30fd-49fe-aac5-5194dc1af58b None None] MFA Rules not processed for user `a463f097e41844d8b5fbb31179895c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:13.519801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-024db356-30fd-49fe-aac5-5194dc1af58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:13.585361 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1354/2728] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:13.596970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd93e47-10ff-4b30-9acd-61b2f9532bb0 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:13.598819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-acd93e47-10ff-4b30-9acd-61b2f9532bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:13.656774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd93e47-10ff-4b30-9acd-61b2f9532bb0 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:13.661330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bd344-c000-48a9-877d-dcec83f4de76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:13.661938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bd344-c000-48a9-877d-dcec83f4de76 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:13.662215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bd344-c000-48a9-877d-dcec83f4de76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:13.662482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bd344-c000-48a9-877d-dcec83f4de76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:13.672475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bd344-c000-48a9-877d-dcec83f4de76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:13.673915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bd344-c000-48a9-877d-dcec83f4de76 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:13.683076 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1375/2729] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:19.166796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024db356-30fd-49fe-aac5-5194dc1af58b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:19.187847 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:19.235808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024db356-30fd-49fe-aac5-5194dc1af58b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:19.240492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:19.241131 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:19.241435 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:19.241704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] PATH_INFO: `/v3/users/a463f097e41844d8b5fbb31179895c4c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:19.242829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a463f097e41844d8b5fbb31179895c4c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:19.244791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:19.293782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a463f097e41844d8b5fbb31179895c4c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:19.305723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a463f097e41844d8b5fbb31179895c4c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:19.312797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a463f097e41844d8b5fbb31179895c4c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:19.313738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a463f097e41844d8b5fbb31179895c4c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:19.314364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a463f097e41844d8b5fbb31179895c4c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:19.329572 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1355/2730] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:29:19 2022] DELETE /identity/v3/users/a463f097e41844d8b5fbb31179895c4c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:19.334327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c832b-626d-40e0-8e38-3e1f9d207032 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:19.334817 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c832b-626d-40e0-8e38-3e1f9d207032 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:19.334927 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c832b-626d-40e0-8e38-3e1f9d207032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:19.355167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f13c832b-626d-40e0-8e38-3e1f9d207032 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:19.356397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f13c832b-626d-40e0-8e38-3e1f9d207032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:19.421592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1376/2731] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:19.431861 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:19.433383 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:19.493207 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42cf9f-b61f-4b37-bf4d-2550129139a6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:19.497272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba780af-9dc5-406e-903b-7e54117fa578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:19.497867 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba780af-9dc5-406e-903b-7e54117fa578 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:19.498143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba780af-9dc5-406e-903b-7e54117fa578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:19.498391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba780af-9dc5-406e-903b-7e54117fa578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:19.507851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba780af-9dc5-406e-903b-7e54117fa578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:19.509263 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba780af-9dc5-406e-903b-7e54117fa578 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:19.518723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1356/2732] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:20.048409 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c832b-626d-40e0-8e38-3e1f9d207032 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:20.049903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f13c832b-626d-40e0-8e38-3e1f9d207032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:20.061661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c832b-626d-40e0-8e38-3e1f9d207032 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:20.066823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:20.067493 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.067768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.068038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] PATH_INFO: `/v3/projects/58c5a0854f664c4894d0660d2b784967` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.069162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c5a0854f664c4894d0660d2b784967)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:20.071071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:20.124570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c5a0854f664c4894d0660d2b784967', 'request_id': 'req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:20.127160 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:20.135450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c5a0854f664c4894d0660d2b784967', 'request_id': 'req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:20.142669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c5a0854f664c4894d0660d2b784967', 'request_id': 'req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:20.153632 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] The token cache is being invalidate because project 58c5a0854f664c4894d0660d2b784967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:29:20.153921 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:20.154643 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a30edb9a-c0ef-48d7-abba-f6f0433e79c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:20.156191 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1377/2733] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:29:20 2022] DELETE /identity/v3/projects/58c5a0854f664c4894d0660d2b784967 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:20.161681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5336c0-7d9e-4816-af77-9da2aaee39ca None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.161916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5336c0-7d9e-4816-af77-9da2aaee39ca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.162238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5336c0-7d9e-4816-af77-9da2aaee39ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.185072 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6f5336c0-7d9e-4816-af77-9da2aaee39ca None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:20.186628 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6f5336c0-7d9e-4816-af77-9da2aaee39ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:20.226159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:20.254977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1357/2734] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:20.263062 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25361d-d6d3-4e55-94b4-4fb7edc4a6b7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.263378 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25361d-d6d3-4e55-94b4-4fb7edc4a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.263653 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25361d-d6d3-4e55-94b4-4fb7edc4a6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.284727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2e25361d-d6d3-4e55-94b4-4fb7edc4a6b7 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:20.285945 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2e25361d-d6d3-4e55-94b4-4fb7edc4a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:20.294479 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1378/2735] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:20.298780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5336c0-7d9e-4816-af77-9da2aaee39ca None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:20.309459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5336c0-7d9e-4816-af77-9da2aaee39ca None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:20.314808 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cffb2c-c452-4916-ab16-e5a5e1b4abcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:20.315438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cffb2c-c452-4916-ab16-e5a5e1b4abcc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.315710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cffb2c-c452-4916-ab16-e5a5e1b4abcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.315977 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cffb2c-c452-4916-ab16-e5a5e1b4abcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.316624 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cffb2c-c452-4916-ab16-e5a5e1b4abcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:29:20.316903 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cffb2c-c452-4916-ab16-e5a5e1b4abcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:20.318490 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cffb2c-c452-4916-ab16-e5a5e1b4abcc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:20.330495 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1358/2736] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:29:20.335192 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25361d-d6d3-4e55-94b4-4fb7edc4a6b7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:20.345175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25361d-d6d3-4e55-94b4-4fb7edc4a6b7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:20.350906 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa449f8-ca4c-4abe-99b8-f6adf549d774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:20.351555 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa449f8-ca4c-4abe-99b8-f6adf549d774 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.351922 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa449f8-ca4c-4abe-99b8-f6adf549d774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.352197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa449f8-ca4c-4abe-99b8-f6adf549d774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.352832 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa449f8-ca4c-4abe-99b8-f6adf549d774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:20.354766 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa449f8-ca4c-4abe-99b8-f6adf549d774 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:20.385905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1379/2737] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:29:20 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:29:20.391941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cffb2c-c452-4916-ab16-e5a5e1b4abcc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:20.402665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cffb2c-c452-4916-ab16-e5a5e1b4abcc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:20.460691 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265eb2b-fb7f-4ead-b776-b5a3f22f2963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:20.461218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265eb2b-fb7f-4ead-b776-b5a3f22f2963 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.461496 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265eb2b-fb7f-4ead-b776-b5a3f22f2963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.461768 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265eb2b-fb7f-4ead-b776-b5a3f22f2963 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.462392 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265eb2b-fb7f-4ead-b776-b5a3f22f2963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:20.464347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265eb2b-fb7f-4ead-b776-b5a3f22f2963 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:20.490002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1359/2738] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:29:20 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:29:20.494306 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa449f8-ca4c-4abe-99b8-f6adf549d774 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:20.505231 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa449f8-ca4c-4abe-99b8-f6adf549d774 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:20.511289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c44f13-d98a-4401-b35d-554977e8f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:20.511936 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c44f13-d98a-4401-b35d-554977e8f5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.512242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c44f13-d98a-4401-b35d-554977e8f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.512511 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c44f13-d98a-4401-b35d-554977e8f5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.513159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c44f13-d98a-4401-b35d-554977e8f5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:20.514812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c44f13-d98a-4401-b35d-554977e8f5f2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:20.525864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1380/2739] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:20.530020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265eb2b-fb7f-4ead-b776-b5a3f22f2963 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:20.540388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265eb2b-fb7f-4ead-b776-b5a3f22f2963 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:20.545542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f53e4-9c31-418c-a08b-9a29f5470489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:20.546145 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f53e4-9c31-418c-a08b-9a29f5470489 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.546426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f53e4-9c31-418c-a08b-9a29f5470489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.546703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f53e4-9c31-418c-a08b-9a29f5470489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.547371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f53e4-9c31-418c-a08b-9a29f5470489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:20.548982 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f53e4-9c31-418c-a08b-9a29f5470489 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:20.559690 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1360/2740] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:20.564369 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c44f13-d98a-4401-b35d-554977e8f5f2 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:20.575088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c44f13-d98a-4401-b35d-554977e8f5f2 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:20.581645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c94798-ebfb-4eac-8ad3-b1c425a6ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:20.582297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c94798-ebfb-4eac-8ad3-b1c425a6ca59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.582575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c94798-ebfb-4eac-8ad3-b1c425a6ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.582856 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c94798-ebfb-4eac-8ad3-b1c425a6ca59 admin admin] PATH_INFO: `/v3/projects/9b23ae1563454e4a8bde72a25f9f2ddc/users/11eab443d58345fdab14a9e518ec850b/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.599912 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c94798-ebfb-4eac-8ad3-b1c425a6ca59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b23ae1563454e4a8bde72a25f9f2ddc, user_id=11eab443d58345fdab14a9e518ec850b, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:20.602660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c94798-ebfb-4eac-8ad3-b1c425a6ca59 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:20.625047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1381/2741] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:29:20 2022] PUT /identity/v3/projects/9b23ae1563454e4a8bde72a25f9f2ddc/users/11eab443d58345fdab14a9e518ec850b/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:20.636826 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58af4-d6bf-416c-a683-c48c2530f542 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.637111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58af4-d6bf-416c-a683-c48c2530f542 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.637391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58af4-d6bf-416c-a683-c48c2530f542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.666520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-68b58af4-d6bf-416c-a683-c48c2530f542 None None] MFA Rules not processed for user `11eab443d58345fdab14a9e518ec850b`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:20.668002 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-68b58af4-d6bf-416c-a683-c48c2530f542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:20.748946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1361/2742] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:20.753819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c94798-ebfb-4eac-8ad3-b1c425a6ca59 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:20.820951 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c94798-ebfb-4eac-8ad3-b1c425a6ca59 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:20.826577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90f782-2e91-4021-b386-4558661f7b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:20.827182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90f782-2e91-4021-b386-4558661f7b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.827517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90f782-2e91-4021-b386-4558661f7b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.827799 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90f782-2e91-4021-b386-4558661f7b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.828425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90f782-2e91-4021-b386-4558661f7b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:20.830403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90f782-2e91-4021-b386-4558661f7b1c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:20.860403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1382/2743] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:29:20 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:29:20.864787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58af4-d6bf-416c-a683-c48c2530f542 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:20.882967 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58af4-d6bf-416c-a683-c48c2530f542 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:20.917378 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:20.946018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26c1fd-f0cd-4485-80da-587fe4e6c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:20.946615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26c1fd-f0cd-4485-80da-587fe4e6c102 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:20.946905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26c1fd-f0cd-4485-80da-587fe4e6c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:20.947178 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26c1fd-f0cd-4485-80da-587fe4e6c102 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:20.947834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26c1fd-f0cd-4485-80da-587fe4e6c102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:20.949738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26c1fd-f0cd-4485-80da-587fe4e6c102 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:20.974125 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1362/2744] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:29:20 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:29:20.986451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90f782-2e91-4021-b386-4558661f7b1c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:20.997185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90f782-2e91-4021-b386-4558661f7b1c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:21.002337 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f957ae-8fc4-4f87-b7c2-e104496ba4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:21.002903 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f957ae-8fc4-4f87-b7c2-e104496ba4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.003325 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f957ae-8fc4-4f87-b7c2-e104496ba4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.003623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f957ae-8fc4-4f87-b7c2-e104496ba4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.004264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f957ae-8fc4-4f87-b7c2-e104496ba4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:21.005897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f957ae-8fc4-4f87-b7c2-e104496ba4a1 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:21.016613 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1383/2745] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:21.021344 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26c1fd-f0cd-4485-80da-587fe4e6c102 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:21.033173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26c1fd-f0cd-4485-80da-587fe4e6c102 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:21.040290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88aa9d-ee0d-45d8-9117-1d53ae6c3207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:21.040933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88aa9d-ee0d-45d8-9117-1d53ae6c3207 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.041310 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88aa9d-ee0d-45d8-9117-1d53ae6c3207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.041454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88aa9d-ee0d-45d8-9117-1d53ae6c3207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.042105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88aa9d-ee0d-45d8-9117-1d53ae6c3207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:21.043755 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88aa9d-ee0d-45d8-9117-1d53ae6c3207 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:21.057069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1363/2746] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:21.061478 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f957ae-8fc4-4f87-b7c2-e104496ba4a1 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:21.071980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f957ae-8fc4-4f87-b7c2-e104496ba4a1 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:21.077007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bee2a-e832-4568-8cdf-c06c891ea4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:21.077657 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bee2a-e832-4568-8cdf-c06c891ea4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.077933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bee2a-e832-4568-8cdf-c06c891ea4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.078206 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bee2a-e832-4568-8cdf-c06c891ea4c8 admin admin] PATH_INFO: `/v3/projects/87caa3cb39e84922810f7eb0b521dcf9/users/b60f3f4f48294d7785bb0143496224d1/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.093888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bee2a-e832-4568-8cdf-c06c891ea4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87caa3cb39e84922810f7eb0b521dcf9, user_id=b60f3f4f48294d7785bb0143496224d1, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:21.096841 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bee2a-e832-4568-8cdf-c06c891ea4c8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:21.111777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1384/2747] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:29:21 2022] PUT /identity/v3/projects/87caa3cb39e84922810f7eb0b521dcf9/users/b60f3f4f48294d7785bb0143496224d1/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:21.122581 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a48908-6ee2-4ee1-85b9-214a2587ba7e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.122869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a48908-6ee2-4ee1-85b9-214a2587ba7e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.123140 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a48908-6ee2-4ee1-85b9-214a2587ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.154651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-52a48908-6ee2-4ee1-85b9-214a2587ba7e None None] MFA Rules not processed for user `b60f3f4f48294d7785bb0143496224d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:21.155930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-52a48908-6ee2-4ee1-85b9-214a2587ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:21.235823 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1364/2748] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:21.240860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bee2a-e832-4568-8cdf-c06c891ea4c8 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:21.272078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:21.305818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bee2a-e832-4568-8cdf-c06c891ea4c8 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:21.310681 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673769-20e8-4545-8cc0-6b71082a9583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:21.311294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673769-20e8-4545-8cc0-6b71082a9583 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.311575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673769-20e8-4545-8cc0-6b71082a9583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.311840 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673769-20e8-4545-8cc0-6b71082a9583 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.312461 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673769-20e8-4545-8cc0-6b71082a9583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:21.314440 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673769-20e8-4545-8cc0-6b71082a9583 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:21.344296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1385/2749] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:29:21 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:29:21.350797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a48908-6ee2-4ee1-85b9-214a2587ba7e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:21.365860 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a48908-6ee2-4ee1-85b9-214a2587ba7e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:21.426446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291df66f-ca6f-43f9-86e1-cfaa9352d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:21.427046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291df66f-ca6f-43f9-86e1-cfaa9352d0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.427351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291df66f-ca6f-43f9-86e1-cfaa9352d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.427621 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291df66f-ca6f-43f9-86e1-cfaa9352d0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.428238 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291df66f-ca6f-43f9-86e1-cfaa9352d0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:21.430130 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291df66f-ca6f-43f9-86e1-cfaa9352d0f8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:21.457205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1365/2750] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:29:21 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:29:21.463765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673769-20e8-4545-8cc0-6b71082a9583 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:21.477950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673769-20e8-4545-8cc0-6b71082a9583 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:21.483974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d1251-8ab0-4718-866f-f2f6661ac35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:21.484579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d1251-8ab0-4718-866f-f2f6661ac35d admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.484854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d1251-8ab0-4718-866f-f2f6661ac35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.485123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d1251-8ab0-4718-866f-f2f6661ac35d admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.485762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d1251-8ab0-4718-866f-f2f6661ac35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:21.487420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d1251-8ab0-4718-866f-f2f6661ac35d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:21.498504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1386/2751] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:21.502751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291df66f-ca6f-43f9-86e1-cfaa9352d0f8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:21.513175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291df66f-ca6f-43f9-86e1-cfaa9352d0f8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:21.519046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c34b9d-74f8-4d7d-b8b1-0ee1a368c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:21.519726 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c34b9d-74f8-4d7d-b8b1-0ee1a368c293 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.520022 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c34b9d-74f8-4d7d-b8b1-0ee1a368c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.520284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c34b9d-74f8-4d7d-b8b1-0ee1a368c293 admin admin] PATH_INFO: `/v3/projects/2d66798ea583490a8e64535576deda6f/users/1629f4046fc0453ca12dd7327c503af8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.535766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c34b9d-74f8-4d7d-b8b1-0ee1a368c293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d66798ea583490a8e64535576deda6f, user_id=1629f4046fc0453ca12dd7327c503af8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:21.538343 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c34b9d-74f8-4d7d-b8b1-0ee1a368c293 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:21.554220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1366/2752] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:29:21 2022] PUT /identity/v3/projects/2d66798ea583490a8e64535576deda6f/users/1629f4046fc0453ca12dd7327c503af8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:21.558237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d1251-8ab0-4718-866f-f2f6661ac35d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:21.568692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d1251-8ab0-4718-866f-f2f6661ac35d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:21.629946 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581de01-f2c1-4f03-a62c-f229905c96f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:21.630585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581de01-f2c1-4f03-a62c-f229905c96f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.630846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581de01-f2c1-4f03-a62c-f229905c96f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.631141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581de01-f2c1-4f03-a62c-f229905c96f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.631953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581de01-f2c1-4f03-a62c-f229905c96f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:21.633561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581de01-f2c1-4f03-a62c-f229905c96f3 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:21.646680 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1387/2753] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:21.650963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c34b9d-74f8-4d7d-b8b1-0ee1a368c293 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:21.662017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c34b9d-74f8-4d7d-b8b1-0ee1a368c293 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:21.667703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e286-5552-4edb-b917-65aab253806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:21.668366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e286-5552-4edb-b917-65aab253806e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.668636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e286-5552-4edb-b917-65aab253806e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.668899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e286-5552-4edb-b917-65aab253806e admin admin] PATH_INFO: `/v3/projects/2d66798ea583490a8e64535576deda6f/users/1629f4046fc0453ca12dd7327c503af8/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.670932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3e286-5552-4edb-b917-65aab253806e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d66798ea583490a8e64535576deda6f, user_id=1629f4046fc0453ca12dd7327c503af8, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:21.673669 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3e286-5552-4edb-b917-65aab253806e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:21.677166 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:21.685901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1367/2754] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:29:21 2022] PUT /identity/v3/projects/2d66798ea583490a8e64535576deda6f/users/1629f4046fc0453ca12dd7327c503af8/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:21.697466 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b8f3b-2d33-40f1-a410-2f9c9181dc46 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.697787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b8f3b-2d33-40f1-a410-2f9c9181dc46 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.698060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b8f3b-2d33-40f1-a410-2f9c9181dc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.727348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-364b8f3b-2d33-40f1-a410-2f9c9181dc46 None None] MFA Rules not processed for user `1629f4046fc0453ca12dd7327c503af8`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:21.728524 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-364b8f3b-2d33-40f1-a410-2f9c9181dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:21.798812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1388/2755] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:29:21.810526 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e286-5552-4edb-b917-65aab253806e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:21.812397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7fc3e286-5552-4edb-b917-65aab253806e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:21.870588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e286-5552-4edb-b917-65aab253806e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:21.874556 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51e8f4-5af1-4a86-8662-9cf9e4ecdd00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:21.875144 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51e8f4-5af1-4a86-8662-9cf9e4ecdd00 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:21.875442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51e8f4-5af1-4a86-8662-9cf9e4ecdd00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:21.875709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51e8f4-5af1-4a86-8662-9cf9e4ecdd00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:21.931118 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51e8f4-5af1-4a86-8662-9cf9e4ecdd00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:21.932586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51e8f4-5af1-4a86-8662-9cf9e4ecdd00 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:21.941557 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1368/2756] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:23.495866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b8f3b-2d33-40f1-a410-2f9c9181dc46 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:23.497976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-364b8f3b-2d33-40f1-a410-2f9c9181dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:23.512387 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b8f3b-2d33-40f1-a410-2f9c9181dc46 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:23.516765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7695c-fddd-4482-87a0-ff1d5f778bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:23.517615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7695c-fddd-4482-87a0-ff1d5f778bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:23.518029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7695c-fddd-4482-87a0-ff1d5f778bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:23.518305 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7695c-fddd-4482-87a0-ff1d5f778bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:23.537823 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:23.578238 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7695c-fddd-4482-87a0-ff1d5f778bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:23.579881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7695c-fddd-4482-87a0-ff1d5f778bf8 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:23.592483 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1389/2757] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:24.151928 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51e8f4-5af1-4a86-8662-9cf9e4ecdd00 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:24.161540 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51e8f4-5af1-4a86-8662-9cf9e4ecdd00 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:24.165570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172e77b-2e11-4089-ac28-23efec262d97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:24.166164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e77b-2e11-4089-ac28-23efec262d97 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:24.166447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e77b-2e11-4089-ac28-23efec262d97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:24.166718 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e77b-2e11-4089-ac28-23efec262d97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:24.176536 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172e77b-2e11-4089-ac28-23efec262d97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:24.177931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172e77b-2e11-4089-ac28-23efec262d97 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:24.188374 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1369/2758] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:28.162043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7695c-fddd-4482-87a0-ff1d5f778bf8 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:28.229873 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7695c-fddd-4482-87a0-ff1d5f778bf8 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:28.234538 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:28.235173 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:28.235484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:28.235871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] PATH_INFO: `/v3/users/11eab443d58345fdab14a9e518ec850b` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:28.237016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11eab443d58345fdab14a9e518ec850b)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:28.238953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:28.291342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11eab443d58345fdab14a9e518ec850b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:28.303497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11eab443d58345fdab14a9e518ec850b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:28.312711 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11eab443d58345fdab14a9e518ec850b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:28.313614 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11eab443d58345fdab14a9e518ec850b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:28.314347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11eab443d58345fdab14a9e518ec850b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:28.331548 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1390/2759] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:29:28 2022] DELETE /identity/v3/users/11eab443d58345fdab14a9e518ec850b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:28.335943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8ef7c-920e-4d95-b5d5-256d097b4ad8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:28.336415 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8ef7c-920e-4d95-b5d5-256d097b4ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:28.336656 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8ef7c-920e-4d95-b5d5-256d097b4ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:28.357054 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-12d8ef7c-920e-4d95-b5d5-256d097b4ad8 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:28.358299 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-12d8ef7c-920e-4d95-b5d5-256d097b4ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:28.421995 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1370/2760] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:28.451622 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:28.453470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:28.501340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:28.518539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad13a3b-d8cc-4042-b6b8-aab26bdb4498 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:28.522473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02668a46-b464-4486-b09d-000bbd01c57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:28.523112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02668a46-b464-4486-b09d-000bbd01c57b service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:28.523424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02668a46-b464-4486-b09d-000bbd01c57b service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:28.523705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02668a46-b464-4486-b09d-000bbd01c57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:28.533848 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02668a46-b464-4486-b09d-000bbd01c57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:28.535317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02668a46-b464-4486-b09d-000bbd01c57b service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:28.544933 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1391/2761] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:28.870206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8543770-fcf1-4c3a-be1f-e60563624efc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:28.870483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8543770-fcf1-4c3a-be1f-e60563624efc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:28.870804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8543770-fcf1-4c3a-be1f-e60563624efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:28.892411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e8543770-fcf1-4c3a-be1f-e60563624efc None None] MFA Rules not processed for user `4c310b330d8c43e987dcd29193042c87`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:28.893794 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e8543770-fcf1-4c3a-be1f-e60563624efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:28.929084 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:28.953905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1371/2762] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:28.988182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02668a46-b464-4486-b09d-000bbd01c57b service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:28.990147 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-02668a46-b464-4486-b09d-000bbd01c57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:29.004288 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02668a46-b464-4486-b09d-000bbd01c57b service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:29.009789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:29.010425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:29.010707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:29.010967 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] PATH_INFO: `/v3/projects/9b23ae1563454e4a8bde72a25f9f2ddc` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:29.012644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b23ae1563454e4a8bde72a25f9f2ddc)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:29.015044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:29.063813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b23ae1563454e4a8bde72a25f9f2ddc', 'request_id': 'req-d71e678c-9ec6-4062-bb09-1824f75d052b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.072718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b23ae1563454e4a8bde72a25f9f2ddc', 'request_id': 'req-d71e678c-9ec6-4062-bb09-1824f75d052b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.079296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b23ae1563454e4a8bde72a25f9f2ddc', 'request_id': 'req-d71e678c-9ec6-4062-bb09-1824f75d052b'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.090383 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] The token cache is being invalidate because project 9b23ae1563454e4a8bde72a25f9f2ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:29:29.090667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.091348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.093418 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1392/2763] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:29:28 2022] DELETE /identity/v3/projects/9b23ae1563454e4a8bde72a25f9f2ddc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:29:29.097153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8543770-fcf1-4c3a-be1f-e60563624efc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:29.108066 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8543770-fcf1-4c3a-be1f-e60563624efc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:29.166417 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:29.167210 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:29.167531 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:29.167806 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] PATH_INFO: `/v3/users/b60f3f4f48294d7785bb0143496224d1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:29.169020 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60f3f4f48294d7785bb0143496224d1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:29.170921 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:29.225830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60f3f4f48294d7785bb0143496224d1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.239112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60f3f4f48294d7785bb0143496224d1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.246111 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60f3f4f48294d7785bb0143496224d1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.246886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60f3f4f48294d7785bb0143496224d1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.247550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60f3f4f48294d7785bb0143496224d1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.261915 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1372/2764] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:29:29 2022] DELETE /identity/v3/users/b60f3f4f48294d7785bb0143496224d1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:29.554774 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:29.556298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:29.578625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e678c-9ec6-4062-bb09-1824f75d052b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:29.660303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:29.661463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:29.661463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:29.661819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] PATH_INFO: `/v3/projects/87caa3cb39e84922810f7eb0b521dcf9` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:29.664389 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=87caa3cb39e84922810f7eb0b521dcf9)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:29.671220 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:29.723021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87caa3cb39e84922810f7eb0b521dcf9', 'request_id': 'req-736c146e-59d6-4820-bb0c-31c38b635dfd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.732477 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87caa3cb39e84922810f7eb0b521dcf9', 'request_id': 'req-736c146e-59d6-4820-bb0c-31c38b635dfd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.738705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87caa3cb39e84922810f7eb0b521dcf9', 'request_id': 'req-736c146e-59d6-4820-bb0c-31c38b635dfd'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.744089 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:29.757580 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] The token cache is being invalidate because project 87caa3cb39e84922810f7eb0b521dcf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:29:29.758078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.759371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.761050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1393/2765] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:29:29 2022] DELETE /identity/v3/projects/87caa3cb39e84922810f7eb0b521dcf9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:29.765087 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:29.766550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:29.780420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3944a-d06e-4800-b395-ec68efac16bf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:29.843051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:29.843783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:29.844153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:29.844426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] PATH_INFO: `/v3/users/1629f4046fc0453ca12dd7327c503af8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:29.845550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1629f4046fc0453ca12dd7327c503af8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:29.847558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:29.849996 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:29.899065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1629f4046fc0453ca12dd7327c503af8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.911433 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1629f4046fc0453ca12dd7327c503af8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.918703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1629f4046fc0453ca12dd7327c503af8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.919446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1629f4046fc0453ca12dd7327c503af8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.920052 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-af33ffdd-ea9a-4f04-95f0-ce42d0ab4b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1629f4046fc0453ca12dd7327c503af8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:29.934500 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1373/2766] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:29:29 2022] DELETE /identity/v3/users/1629f4046fc0453ca12dd7327c503af8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:30.225011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:30.226512 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:30.246811 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c146e-59d6-4820-bb0c-31c38b635dfd admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:30.311890 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:30.312533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:30.312819 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:30.313096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] PATH_INFO: `/v3/projects/2d66798ea583490a8e64535576deda6f` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:30.314210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d66798ea583490a8e64535576deda6f)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:30.316408 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:30.365849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d66798ea583490a8e64535576deda6f', 'request_id': 'req-87b882a4-dd9f-4056-8209-7da9ae0f364e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:30.375530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d66798ea583490a8e64535576deda6f', 'request_id': 'req-87b882a4-dd9f-4056-8209-7da9ae0f364e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:30.381820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d66798ea583490a8e64535576deda6f', 'request_id': 'req-87b882a4-dd9f-4056-8209-7da9ae0f364e'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:30.392021 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] The token cache is being invalidate because project 2d66798ea583490a8e64535576deda6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:29:30.392316 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:30.392994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-87b882a4-dd9f-4056-8209-7da9ae0f364e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:30.394529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1394/2767] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:29:30 2022] DELETE /identity/v3/projects/2d66798ea583490a8e64535576deda6f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:30.400786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a033f4f-71df-403a-97ec-a903edf41c2f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:30.401076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a033f4f-71df-403a-97ec-a903edf41c2f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:30.401355 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a033f4f-71df-403a-97ec-a903edf41c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:30.422932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7a033f4f-71df-403a-97ec-a903edf41c2f None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:30.424187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7a033f4f-71df-403a-97ec-a903edf41c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:30.489233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1374/2768] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:30.497426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8aaa-fe16-43d1-ba18-4f7a76546ae6 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:30.497710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8aaa-fe16-43d1-ba18-4f7a76546ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:30.497984 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8aaa-fe16-43d1-ba18-4f7a76546ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:30.519138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-893a8aaa-fe16-43d1-ba18-4f7a76546ae6 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:30.520331 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-893a8aaa-fe16-43d1-ba18-4f7a76546ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:30.528938 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1395/2769] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:30.533506 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a033f4f-71df-403a-97ec-a903edf41c2f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:30.543810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a033f4f-71df-403a-97ec-a903edf41c2f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:30.549420 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9089c96-6d4b-4b41-8e91-c002b77c826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:30.550041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9089c96-6d4b-4b41-8e91-c002b77c826e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:30.550346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9089c96-6d4b-4b41-8e91-c002b77c826e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:30.551580 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9089c96-6d4b-4b41-8e91-c002b77c826e admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:30.552703 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9089c96-6d4b-4b41-8e91-c002b77c826e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:29:30.553006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9089c96-6d4b-4b41-8e91-c002b77c826e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:30.554907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9089c96-6d4b-4b41-8e91-c002b77c826e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:30.568214 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1375/2770] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:29:30.572710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a8aaa-fe16-43d1-ba18-4f7a76546ae6 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:30.582266 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a8aaa-fe16-43d1-ba18-4f7a76546ae6 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:30.587329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c8e3f-d686-4cbe-bc61-d37fdd3e30cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:30.587944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c8e3f-d686-4cbe-bc61-d37fdd3e30cd admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:30.588227 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c8e3f-d686-4cbe-bc61-d37fdd3e30cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:30.588503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c8e3f-d686-4cbe-bc61-d37fdd3e30cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:30.589485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c8e3f-d686-4cbe-bc61-d37fdd3e30cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:30.591522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c8e3f-d686-4cbe-bc61-d37fdd3e30cd admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:30.624790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1396/2771] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:29:30 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:29:30.625989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9089c96-6d4b-4b41-8e91-c002b77c826e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:30.636640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9089c96-6d4b-4b41-8e91-c002b77c826e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:30.703947 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab709b-cc5d-4f2f-88e0-0ef4b57ac42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:30.704692 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab709b-cc5d-4f2f-88e0-0ef4b57ac42e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:30.705093 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab709b-cc5d-4f2f-88e0-0ef4b57ac42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:30.705428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab709b-cc5d-4f2f-88e0-0ef4b57ac42e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:30.706223 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab709b-cc5d-4f2f-88e0-0ef4b57ac42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:30.708769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab709b-cc5d-4f2f-88e0-0ef4b57ac42e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:30.733207 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:30.740834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1376/2772] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:29:30 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:29:30.745298 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c8e3f-d686-4cbe-bc61-d37fdd3e30cd admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:30.757732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c8e3f-d686-4cbe-bc61-d37fdd3e30cd admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:30.763187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784b4e9-587e-4b36-83d6-0a93aa70d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:30.764659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784b4e9-587e-4b36-83d6-0a93aa70d210 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:30.764659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784b4e9-587e-4b36-83d6-0a93aa70d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:30.764901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784b4e9-587e-4b36-83d6-0a93aa70d210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:30.765668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784b4e9-587e-4b36-83d6-0a93aa70d210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:30.767460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784b4e9-587e-4b36-83d6-0a93aa70d210 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:30.783530 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1397/2773] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:29:30.785231 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab709b-cc5d-4f2f-88e0-0ef4b57ac42e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:30.799848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab709b-cc5d-4f2f-88e0-0ef4b57ac42e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:30.809112 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa90f-4306-4859-9296-154701b36509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:30.812032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa90f-4306-4859-9296-154701b36509 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:30.813640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa90f-4306-4859-9296-154701b36509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:30.814019 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa90f-4306-4859-9296-154701b36509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:30.814901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caa90f-4306-4859-9296-154701b36509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:30.821181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caa90f-4306-4859-9296-154701b36509 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:30.838340 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1377/2774] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:30.843219 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784b4e9-587e-4b36-83d6-0a93aa70d210 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:30.856720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784b4e9-587e-4b36-83d6-0a93aa70d210 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:30.862731 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0237eb-6640-49b1-88fe-ceeb249b1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:30.863769 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0237eb-6640-49b1-88fe-ceeb249b1fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:30.864077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0237eb-6640-49b1-88fe-ceeb249b1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:30.864585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0237eb-6640-49b1-88fe-ceeb249b1fe8 admin admin] PATH_INFO: `/v3/projects/df3c3682f8f942e8bb6ce14b9b4a75bd/users/df3715b61c5942c0872e89ea4dc77829/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:30.882747 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0237eb-6640-49b1-88fe-ceeb249b1fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3c3682f8f942e8bb6ce14b9b4a75bd, user_id=df3715b61c5942c0872e89ea4dc77829, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:30.885615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0237eb-6640-49b1-88fe-ceeb249b1fe8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:30.902230 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1398/2775] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:29:30 2022] PUT /identity/v3/projects/df3c3682f8f942e8bb6ce14b9b4a75bd/users/df3715b61c5942c0872e89ea4dc77829/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:29:30.912917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb197-f858-4141-b886-d6448b5f36e4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:30.913197 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb197-f858-4141-b886-d6448b5f36e4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:30.913465 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb197-f858-4141-b886-d6448b5f36e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:30.942627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9aebb197-f858-4141-b886-d6448b5f36e4 None None] MFA Rules not processed for user `df3715b61c5942c0872e89ea4dc77829`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:30.943993 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9aebb197-f858-4141-b886-d6448b5f36e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:31.026626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1378/2776] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:31.037522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0237eb-6640-49b1-88fe-ceeb249b1fe8 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:31.039237 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8b0237eb-6640-49b1-88fe-ceeb249b1fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:31.066462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:31.100560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0237eb-6640-49b1-88fe-ceeb249b1fe8 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:31.104287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de795c3-6b82-459e-b168-62416c30de69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:31.104902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de795c3-6b82-459e-b168-62416c30de69 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:31.105180 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de795c3-6b82-459e-b168-62416c30de69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:31.105460 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de795c3-6b82-459e-b168-62416c30de69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:31.114327 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de795c3-6b82-459e-b168-62416c30de69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:31.115820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de795c3-6b82-459e-b168-62416c30de69 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:31.124877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1399/2777] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:41.023483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=38 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:41.120754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=16 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:41.328784 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebb197-f858-4141-b886-d6448b5f36e4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:41.392499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebb197-f858-4141-b886-d6448b5f36e4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:41.397044 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:41.397677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:41.397950 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:41.398220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] PATH_INFO: `/v3/users/df3715b61c5942c0872e89ea4dc77829` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:41.399388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3715b61c5942c0872e89ea4dc77829)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:41.401290 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:41.454393 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3715b61c5942c0872e89ea4dc77829'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:41.468566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3715b61c5942c0872e89ea4dc77829'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:41.478106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3715b61c5942c0872e89ea4dc77829'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:41.479012 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3715b61c5942c0872e89ea4dc77829'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:41.480281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3715b61c5942c0872e89ea4dc77829'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:41.496595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1379/2778] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:29:41 2022] DELETE /identity/v3/users/df3715b61c5942c0872e89ea4dc77829 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:41.502068 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19013-f6c7-4562-8a1f-751d80af39e3 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:41.502603 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19013-f6c7-4562-8a1f-751d80af39e3 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:41.503005 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19013-f6c7-4562-8a1f-751d80af39e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:41.525181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-62f19013-f6c7-4562-8a1f-751d80af39e3 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:41.526676 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-62f19013-f6c7-4562-8a1f-751d80af39e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:41.595510 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1400/2779] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:29:41.603729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:41.605323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:41.668042 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42dd94-16d8-4580-8616-e0e8367efc32 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:41.672311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c42c5-5c0a-4d04-b033-06c9a9345e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:41.673117 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c42c5-5c0a-4d04-b033-06c9a9345e05 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:41.673454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c42c5-5c0a-4d04-b033-06c9a9345e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:41.673788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c42c5-5c0a-4d04-b033-06c9a9345e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:41.686265 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c42c5-5c0a-4d04-b033-06c9a9345e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:41.687849 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c42c5-5c0a-4d04-b033-06c9a9345e05 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:41.700181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1380/2780] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:42.004096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19013-f6c7-4562-8a1f-751d80af39e3 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:42.005854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-62f19013-f6c7-4562-8a1f-751d80af39e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:42.019518 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19013-f6c7-4562-8a1f-751d80af39e3 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:42.024371 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:42.025091 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.025435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.025767 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] PATH_INFO: `/v3/projects/df3c3682f8f942e8bb6ce14b9b4a75bd` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.026959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3c3682f8f942e8bb6ce14b9b4a75bd)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:42.029421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:42.087641 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3c3682f8f942e8bb6ce14b9b4a75bd', 'request_id': 'req-6dc96919-f02f-4b35-a803-f05c719c9768'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:42.097668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3c3682f8f942e8bb6ce14b9b4a75bd', 'request_id': 'req-6dc96919-f02f-4b35-a803-f05c719c9768'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:42.105195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3c3682f8f942e8bb6ce14b9b4a75bd', 'request_id': 'req-6dc96919-f02f-4b35-a803-f05c719c9768'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:42.120929 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] The token cache is being invalidate because project df3c3682f8f942e8bb6ce14b9b4a75bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:29:42.121586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:42.121919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-6dc96919-f02f-4b35-a803-f05c719c9768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:42.124182 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1401/2781] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:29:42 2022] DELETE /identity/v3/projects/df3c3682f8f942e8bb6ce14b9b4a75bd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:42.129211 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6141b-c965-4c25-a1d8-fbbccd451184 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.129702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6141b-c965-4c25-a1d8-fbbccd451184 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.129804 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6141b-c965-4c25-a1d8-fbbccd451184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.152822 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e7b6141b-c965-4c25-a1d8-fbbccd451184 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:42.154041 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e7b6141b-c965-4c25-a1d8-fbbccd451184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:42.184565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:42.224205 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1381/2782] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:42.232164 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f386f6d-7c4d-4452-b723-6826c9931363 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.232471 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f386f6d-7c4d-4452-b723-6826c9931363 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.232754 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f386f6d-7c4d-4452-b723-6826c9931363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.252709 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-6f386f6d-7c4d-4452-b723-6826c9931363 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:42.254427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-6f386f6d-7c4d-4452-b723-6826c9931363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:42.262796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1402/2783] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:29:42.267171 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6141b-c965-4c25-a1d8-fbbccd451184 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:42.277017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6141b-c965-4c25-a1d8-fbbccd451184 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:42.281730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bddbd-4c99-4f63-ae15-11030aa00fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:42.282336 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bddbd-4c99-4f63-ae15-11030aa00fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.282610 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bddbd-4c99-4f63-ae15-11030aa00fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.282878 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bddbd-4c99-4f63-ae15-11030aa00fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.283552 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bddbd-4c99-4f63-ae15-11030aa00fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:29:42.283985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bddbd-4c99-4f63-ae15-11030aa00fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:42.285577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bddbd-4c99-4f63-ae15-11030aa00fd7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:42.298182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1382/2784] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:29:42.302570 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f386f6d-7c4d-4452-b723-6826c9931363 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:42.312574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f386f6d-7c4d-4452-b723-6826c9931363 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:42.317361 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ed2f-b3ec-4cd3-9154-2c77ae01bfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:42.322838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ed2f-b3ec-4cd3-9154-2c77ae01bfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.323131 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ed2f-b3ec-4cd3-9154-2c77ae01bfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.323494 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ed2f-b3ec-4cd3-9154-2c77ae01bfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.324157 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5ed2f-b3ec-4cd3-9154-2c77ae01bfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:42.326112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5ed2f-b3ec-4cd3-9154-2c77ae01bfc8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:42.356910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1403/2785] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:29:42 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:29:42.361416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bddbd-4c99-4f63-ae15-11030aa00fd7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:42.372133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bddbd-4c99-4f63-ae15-11030aa00fd7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:42.431678 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aa8c3-27a0-482d-9ca8-5cc89115da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:42.432793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aa8c3-27a0-482d-9ca8-5cc89115da2b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.432793 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aa8c3-27a0-482d-9ca8-5cc89115da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.433014 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aa8c3-27a0-482d-9ca8-5cc89115da2b admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.433565 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067aa8c3-27a0-482d-9ca8-5cc89115da2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:42.435493 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067aa8c3-27a0-482d-9ca8-5cc89115da2b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:42.462132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1383/2786] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:29:42 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:29:42.466859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ed2f-b3ec-4cd3-9154-2c77ae01bfc8 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:42.477377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ed2f-b3ec-4cd3-9154-2c77ae01bfc8 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:42.481851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bb8c1-5186-4b6b-a25a-a54e3ffe4a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:42.482448 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bb8c1-5186-4b6b-a25a-a54e3ffe4a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.482724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bb8c1-5186-4b6b-a25a-a54e3ffe4a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.483000 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bb8c1-5186-4b6b-a25a-a54e3ffe4a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.483668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bb8c1-5186-4b6b-a25a-a54e3ffe4a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:42.485264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bb8c1-5186-4b6b-a25a-a54e3ffe4a5b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:42.495397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1404/2787] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:42.499639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aa8c3-27a0-482d-9ca8-5cc89115da2b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:42.510085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aa8c3-27a0-482d-9ca8-5cc89115da2b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:42.514979 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27af7a-25de-4bde-8b89-539107588cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:42.515636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27af7a-25de-4bde-8b89-539107588cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.515913 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27af7a-25de-4bde-8b89-539107588cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.516182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27af7a-25de-4bde-8b89-539107588cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.516945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27af7a-25de-4bde-8b89-539107588cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:42.518526 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27af7a-25de-4bde-8b89-539107588cf6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:42.529595 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1384/2788] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:42.533953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bb8c1-5186-4b6b-a25a-a54e3ffe4a5b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:42.544257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bb8c1-5186-4b6b-a25a-a54e3ffe4a5b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:42.549170 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330304-e781-4cbf-ad16-e32adaa002cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:42.549932 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330304-e781-4cbf-ad16-e32adaa002cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.550109 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330304-e781-4cbf-ad16-e32adaa002cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.550363 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330304-e781-4cbf-ad16-e32adaa002cf admin admin] PATH_INFO: `/v3/projects/385ac47c5e0447ed97d102646ebea7fc/users/c839415c1a134ce082ba9e4eb9f3ba68/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.567024 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330304-e781-4cbf-ad16-e32adaa002cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=385ac47c5e0447ed97d102646ebea7fc, user_id=c839415c1a134ce082ba9e4eb9f3ba68, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:42.569863 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330304-e781-4cbf-ad16-e32adaa002cf admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:42.584271 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1405/2789] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:29:42 2022] PUT /identity/v3/projects/385ac47c5e0447ed97d102646ebea7fc/users/c839415c1a134ce082ba9e4eb9f3ba68/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:42.595143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea6e6-3cb9-4191-9620-0d333b996fd1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.595458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea6e6-3cb9-4191-9620-0d333b996fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.595731 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea6e6-3cb9-4191-9620-0d333b996fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.631150 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-212ea6e6-3cb9-4191-9620-0d333b996fd1 None None] MFA Rules not processed for user `c839415c1a134ce082ba9e4eb9f3ba68`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:42.632478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-212ea6e6-3cb9-4191-9620-0d333b996fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:42.702428 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1385/2790] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:42.714071 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330304-e781-4cbf-ad16-e32adaa002cf admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:42.715953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-88330304-e781-4cbf-ad16-e32adaa002cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:42.740403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:42.777710 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330304-e781-4cbf-ad16-e32adaa002cf admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:42.781533 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4fc06-9448-4fe9-ab7b-373561b0c7f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:42.782146 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4fc06-9448-4fe9-ab7b-373561b0c7f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:42.782420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4fc06-9448-4fe9-ab7b-373561b0c7f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:42.782679 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4fc06-9448-4fe9-ab7b-373561b0c7f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:42.791586 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4fc06-9448-4fe9-ab7b-373561b0c7f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:42.793038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4fc06-9448-4fe9-ab7b-373561b0c7f8 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:42.802195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1406/2791] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:52.699316 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:52.798281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=17 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:53.046549 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ea6e6-3cb9-4191-9620-0d333b996fd1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:53.115274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ea6e6-3cb9-4191-9620-0d333b996fd1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:53.121047 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:53.121680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:53.121965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:53.122237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] PATH_INFO: `/v3/users/c839415c1a134ce082ba9e4eb9f3ba68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:53.123459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c839415c1a134ce082ba9e4eb9f3ba68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:53.125489 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:53.180879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c839415c1a134ce082ba9e4eb9f3ba68'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:53.193397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c839415c1a134ce082ba9e4eb9f3ba68'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:53.200553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c839415c1a134ce082ba9e4eb9f3ba68'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:53.201373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c839415c1a134ce082ba9e4eb9f3ba68'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:53.202113 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c839415c1a134ce082ba9e4eb9f3ba68'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:53.218177 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1386/2792] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:29:53 2022] DELETE /identity/v3/users/c839415c1a134ce082ba9e4eb9f3ba68 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:53.222813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd65464-527d-44f6-8762-f811bf298631 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:53.223105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd65464-527d-44f6-8762-f811bf298631 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:53.223432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd65464-527d-44f6-8762-f811bf298631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:53.243277 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5cd65464-527d-44f6-8762-f811bf298631 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:53.244513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5cd65464-527d-44f6-8762-f811bf298631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:53.305425 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1407/2793] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:53.316738 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:53.318243 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:53.384091 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf699795-2fc8-4442-8cbc-0486c5b1187f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:53.388063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3d66-f89a-41f7-a2f4-80bc96a15be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:53.388677 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3d66-f89a-41f7-a2f4-80bc96a15be3 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:53.388954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3d66-f89a-41f7-a2f4-80bc96a15be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:53.389227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3d66-f89a-41f7-a2f4-80bc96a15be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:53.398613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3d66-f89a-41f7-a2f4-80bc96a15be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:53.400063 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3d66-f89a-41f7-a2f4-80bc96a15be3 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:53.409627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1387/2794] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:53.684944 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd65464-527d-44f6-8762-f811bf298631 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:53.686773 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5cd65464-527d-44f6-8762-f811bf298631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:53.700138 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd65464-527d-44f6-8762-f811bf298631 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:53.706809 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:53.707669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:53.707953 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:53.708222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] PATH_INFO: `/v3/projects/385ac47c5e0447ed97d102646ebea7fc` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:53.709451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385ac47c5e0447ed97d102646ebea7fc)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:53.711645 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:53.761804 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385ac47c5e0447ed97d102646ebea7fc', 'request_id': 'req-a98360e5-780c-49b1-b672-4711f8508a03'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:53.772792 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385ac47c5e0447ed97d102646ebea7fc', 'request_id': 'req-a98360e5-780c-49b1-b672-4711f8508a03'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:53.779959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385ac47c5e0447ed97d102646ebea7fc', 'request_id': 'req-a98360e5-780c-49b1-b672-4711f8508a03'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:53.790426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] The token cache is being invalidate because project 385ac47c5e0447ed97d102646ebea7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:29:53.790716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:53.791421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-a98360e5-780c-49b1-b672-4711f8508a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:53.792957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1408/2795] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:29:53 2022] DELETE /identity/v3/projects/385ac47c5e0447ed97d102646ebea7fc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:29:53.797841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c300d45-a26d-49d2-a2d7-1573829b8f91 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:53.798297 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c300d45-a26d-49d2-a2d7-1573829b8f91 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:53.798487 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c300d45-a26d-49d2-a2d7-1573829b8f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:53.819055 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3c300d45-a26d-49d2-a2d7-1573829b8f91 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:53.820294 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3c300d45-a26d-49d2-a2d7-1573829b8f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:53.839387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:53.891904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1388/2796] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:53.957589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15243f-ee0e-488f-9c9c-25d43144f76a None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:53.958166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15243f-ee0e-488f-9c9c-25d43144f76a None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:53.958166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15243f-ee0e-488f-9c9c-25d43144f76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:53.979989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-5c15243f-ee0e-488f-9c9c-25d43144f76a None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:53.981214 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5c15243f-ee0e-488f-9c9c-25d43144f76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:53.990589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1409/2797] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:53.994732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c300d45-a26d-49d2-a2d7-1573829b8f91 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:54.005097 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c300d45-a26d-49d2-a2d7-1573829b8f91 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:54.010185 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08f52-fe69-498b-8649-00dc66ed88d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:54.010797 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08f52-fe69-498b-8649-00dc66ed88d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:54.011075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08f52-fe69-498b-8649-00dc66ed88d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:54.011388 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08f52-fe69-498b-8649-00dc66ed88d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:54.012036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e08f52-fe69-498b-8649-00dc66ed88d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:29:54.012339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e08f52-fe69-498b-8649-00dc66ed88d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:54.013924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e08f52-fe69-498b-8649-00dc66ed88d8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:54.025625 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1389/2798] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:29:54.030074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15243f-ee0e-488f-9c9c-25d43144f76a None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:54.040384 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15243f-ee0e-488f-9c9c-25d43144f76a None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:54.045568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003ebab-63b2-4c9d-982a-c2d381ffd9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:54.046174 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003ebab-63b2-4c9d-982a-c2d381ffd9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:54.046457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003ebab-63b2-4c9d-982a-c2d381ffd9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:54.046728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003ebab-63b2-4c9d-982a-c2d381ffd9a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:54.047445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003ebab-63b2-4c9d-982a-c2d381ffd9a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:54.049397 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003ebab-63b2-4c9d-982a-c2d381ffd9a9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:54.079111 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1410/2799] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:29:54 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:29:54.084034 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08f52-fe69-498b-8649-00dc66ed88d8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:54.100537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08f52-fe69-498b-8649-00dc66ed88d8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:54.160609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4db8-8ae2-408e-b101-446b21edfe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:54.161211 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4db8-8ae2-408e-b101-446b21edfe43 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:54.161473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4db8-8ae2-408e-b101-446b21edfe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:54.161741 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4db8-8ae2-408e-b101-446b21edfe43 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:54.162363 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf4db8-8ae2-408e-b101-446b21edfe43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:54.164391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf4db8-8ae2-408e-b101-446b21edfe43 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:54.188769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1390/2800] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:29:54 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:29:54.193417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003ebab-63b2-4c9d-982a-c2d381ffd9a9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:54.205253 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003ebab-63b2-4c9d-982a-c2d381ffd9a9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:54.212248 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29242-c575-4a85-bc93-99aaaa3cce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:54.212880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29242-c575-4a85-bc93-99aaaa3cce6d admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:54.213502 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29242-c575-4a85-bc93-99aaaa3cce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:54.213794 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29242-c575-4a85-bc93-99aaaa3cce6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:54.214432 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29242-c575-4a85-bc93-99aaaa3cce6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:54.216072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29242-c575-4a85-bc93-99aaaa3cce6d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:54.226651 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1411/2801] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:54.230883 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4db8-8ae2-408e-b101-446b21edfe43 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:54.241917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4db8-8ae2-408e-b101-446b21edfe43 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:54.246944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e44377-d66f-4d5a-9481-b96b884a0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:54.247586 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44377-d66f-4d5a-9481-b96b884a0a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:54.247869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44377-d66f-4d5a-9481-b96b884a0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:54.248144 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44377-d66f-4d5a-9481-b96b884a0a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:54.248798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e44377-d66f-4d5a-9481-b96b884a0a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:54.250391 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e44377-d66f-4d5a-9481-b96b884a0a86 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:54.263026 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1391/2802] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:29:54.267612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29242-c575-4a85-bc93-99aaaa3cce6d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:54.278766 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29242-c575-4a85-bc93-99aaaa3cce6d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:54.284549 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736956b-8860-4518-a415-b73149521e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:54.285204 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736956b-8860-4518-a415-b73149521e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:54.285488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736956b-8860-4518-a415-b73149521e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:54.285765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736956b-8860-4518-a415-b73149521e0f admin admin] PATH_INFO: `/v3/projects/2ed0062302324eddbf8ae135d6c23562/users/17511c7efe2e4b178b656b1c632a2e3d/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:54.300962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736956b-8860-4518-a415-b73149521e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed0062302324eddbf8ae135d6c23562, user_id=17511c7efe2e4b178b656b1c632a2e3d, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:54.303683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736956b-8860-4518-a415-b73149521e0f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:54.319158 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1412/2803] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:29:54 2022] PUT /identity/v3/projects/2ed0062302324eddbf8ae135d6c23562/users/17511c7efe2e4b178b656b1c632a2e3d/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:54.330134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3a029-2d5e-4530-ae55-4c5029eb592c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:54.330434 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3a029-2d5e-4530-ae55-4c5029eb592c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:54.330704 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3a029-2d5e-4530-ae55-4c5029eb592c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:54.360985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-efa3a029-2d5e-4530-ae55-4c5029eb592c None None] MFA Rules not processed for user `17511c7efe2e4b178b656b1c632a2e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:54.362248 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-efa3a029-2d5e-4530-ae55-4c5029eb592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:54.435788 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1392/2804] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:54.447828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736956b-8860-4518-a415-b73149521e0f admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:54.449738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5736956b-8860-4518-a415-b73149521e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:54.474962 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:54.514942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736956b-8860-4518-a415-b73149521e0f admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:54.518920 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1882bc-4cd2-4b81-a715-26a474fc2a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:54.519567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1882bc-4cd2-4b81-a715-26a474fc2a3e service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:54.519851 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1882bc-4cd2-4b81-a715-26a474fc2a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:54.520112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1882bc-4cd2-4b81-a715-26a474fc2a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:54.529697 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1882bc-4cd2-4b81-a715-26a474fc2a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:54.531142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1882bc-4cd2-4b81-a715-26a474fc2a3e service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:54.540760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1413/2805] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:29:59.625276 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3a029-2d5e-4530-ae55-4c5029eb592c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:59.654665 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:29:59.700634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3a029-2d5e-4530-ae55-4c5029eb592c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:59.705719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:59.706350 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:59.706626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:59.706896 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] PATH_INFO: `/v3/users/17511c7efe2e4b178b656b1c632a2e3d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:59.708052 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] RBAC: Authorizing `identity:delete_user(user_id=17511c7efe2e4b178b656b1c632a2e3d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:59.709972 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:29:59.773493 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17511c7efe2e4b178b656b1c632a2e3d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:59.785838 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17511c7efe2e4b178b656b1c632a2e3d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:59.797879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17511c7efe2e4b178b656b1c632a2e3d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:59.798561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17511c7efe2e4b178b656b1c632a2e3d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:59.799188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17511c7efe2e4b178b656b1c632a2e3d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:29:59.813836 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1393/2806] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:29:59 2022] DELETE /identity/v3/users/17511c7efe2e4b178b656b1c632a2e3d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:29:59.818490 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf4db1-23c8-4ff2-a1e5-473b21d2664c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:59.818998 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf4db1-23c8-4ff2-a1e5-473b21d2664c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:59.819105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf4db1-23c8-4ff2-a1e5-473b21d2664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:59.838758 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-17bf4db1-23c8-4ff2-a1e5-473b21d2664c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:29:59.840324 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-17bf4db1-23c8-4ff2-a1e5-473b21d2664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:59.904179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1414/2807] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:29:59.914154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:29:59.915840 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:29:59.974859 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9367b-f387-4521-a8ad-e99ba139dfda admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:29:59.978846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f299fd7-fe2c-448f-8e27-b32b13578929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:29:59.979483 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f299fd7-fe2c-448f-8e27-b32b13578929 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:29:59.979899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f299fd7-fe2c-448f-8e27-b32b13578929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:29:59.980245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f299fd7-fe2c-448f-8e27-b32b13578929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:29:59.989851 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f299fd7-fe2c-448f-8e27-b32b13578929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:29:59.991300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f299fd7-fe2c-448f-8e27-b32b13578929 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:30:00.001347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1394/2808] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:30:00.288264 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf4db1-23c8-4ff2-a1e5-473b21d2664c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:30:00.289950 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-17bf4db1-23c8-4ff2-a1e5-473b21d2664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:30:00.304696 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf4db1-23c8-4ff2-a1e5-473b21d2664c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:30:00.311286 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:30:00.311968 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:30:00.312287 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:30:00.312506 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] PATH_INFO: `/v3/projects/2ed0062302324eddbf8ae135d6c23562` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:30:00.313646 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed0062302324eddbf8ae135d6c23562)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:30:00.315656 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:30:00.367365 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed0062302324eddbf8ae135d6c23562', 'request_id': 'req-438cf53c-8309-4751-8dc4-fdb0930694a9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:30:00.376744 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed0062302324eddbf8ae135d6c23562', 'request_id': 'req-438cf53c-8309-4751-8dc4-fdb0930694a9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:30:00.383103 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed0062302324eddbf8ae135d6c23562', 'request_id': 'req-438cf53c-8309-4751-8dc4-fdb0930694a9'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:30:00.394149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] The token cache is being invalidate because project 2ed0062302324eddbf8ae135d6c23562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:30:00.394435 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:30:00.395055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:30:00.396573 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1415/2809] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:30:00 2022] DELETE /identity/v3/projects/2ed0062302324eddbf8ae135d6c23562 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:30:09.997049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:30:10.391455 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:30:28.153964 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcd00c-61d2-43e3-9a17-a58afd3fbbc0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:30:28.154463 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcd00c-61d2-43e3-9a17-a58afd3fbbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:30:28.154575 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcd00c-61d2-43e3-9a17-a58afd3fbbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:30:28.175011 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9afcd00c-61d2-43e3-9a17-a58afd3fbbc0 None None] MFA Rules not processed for user `4c310b330d8c43e987dcd29193042c87`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:30:28.176221 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9afcd00c-61d2-43e3-9a17-a58afd3fbbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:30:28.233408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1395/2810] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:30:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:30:38.226287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=25 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:30:43.959423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:30:43.961423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:30:44.102952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cf53c-8309-4751-8dc4-fdb0930694a9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:30:44.108715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b8950-38f1-42f6-bacb-a17366802d3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:30:44.109310 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8950-38f1-42f6-bacb-a17366802d3e service placement] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:30:44.109584 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8950-38f1-42f6-bacb-a17366802d3e service placement] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:30:44.109821 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8950-38f1-42f6-bacb-a17366802d3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:30:44.111626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f24b8950-38f1-42f6-bacb-a17366802d3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:30:44.123635 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b8950-38f1-42f6-bacb-a17366802d3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:30:44.125201 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b8950-38f1-42f6-bacb-a17366802d3e service placement] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:30:44.135037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1416/2811] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:30:54.131078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=63 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:31:23.800288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98711e-ebd9-49d9-8a65-6ee27d7700e8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:31:23.800934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98711e-ebd9-49d9-8a65-6ee27d7700e8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:31:23.800934 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98711e-ebd9-49d9-8a65-6ee27d7700e8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:31:23.802187 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1396/2812] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:31:23.808347 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7aedc-1e9a-4887-b664-f9ed7c801781 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:31:23.808817 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7aedc-1e9a-4887-b664-f9ed7c801781 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:31:23.809016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7aedc-1e9a-4887-b664-f9ed7c801781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:31:23.861604 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-3ff7aedc-1e9a-4887-b664-f9ed7c801781 None None] MFA Rules not processed for user `8bec5c8c626c40ef9906783916c49dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:31:23.864837 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-3ff7aedc-1e9a-4887-b664-f9ed7c801781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:31:23.931759 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1417/2813] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:31:23.943899 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98711e-ebd9-49d9-8a65-6ee27d7700e8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:31:23.945783 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7b98711e-ebd9-49d9-8a65-6ee27d7700e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:31:23.959425 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98711e-ebd9-49d9-8a65-6ee27d7700e8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:31:23.962868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea0a60-1570-4dde-a1db-6b71f7d0c8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:31:23.963505 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea0a60-1570-4dde-a1db-6b71f7d0c8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:31:23.963782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea0a60-1570-4dde-a1db-6b71f7d0c8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:31:23.964046 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea0a60-1570-4dde-a1db-6b71f7d0c8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:31:23.972114 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea0a60-1570-4dde-a1db-6b71f7d0c8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:31:23.973620 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea0a60-1570-4dde-a1db-6b71f7d0c8b3 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:31:23.982330 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1397/2814] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:31:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:31:24.071316 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c7a47-8504-4928-97e5-6035c7598116 None None] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:31:24.072166 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c7a47-8504-4928-97e5-6035c7598116 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:31:24.072394 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c7a47-8504-4928-97e5-6035c7598116 None None] PATH_INFO: `/` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:31:24.073790 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1418/2815] 10.222.0.39 () {54 vars in 921 bytes} [Sat Sep 3 01:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 01:31:24.083467 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683d63-e469-456f-94b3-e036e88dcdcd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:31:24.083751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683d63-e469-456f-94b3-e036e88dcdcd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:31:24.084411 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683d63-e469-456f-94b3-e036e88dcdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:31:24.118060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-34683d63-e469-456f-94b3-e036e88dcdcd None None] MFA Rules not processed for user `9c4076fd5abc4b508a0215ce22af85d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:31:24.119311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-34683d63-e469-456f-94b3-e036e88dcdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:31:24.211931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1398/2816] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Sep 3 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:31:24.223400 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c7a47-8504-4928-97e5-6035c7598116 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:31:24.225568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-251c7a47-8504-4928-97e5-6035c7598116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:31:24.240692 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c7a47-8504-4928-97e5-6035c7598116 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:31:24.244197 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee0a91-3831-42d0-86ef-202bc665296f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:31:24.247299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee0a91-3831-42d0-86ef-202bc665296f service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:31:24.247299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee0a91-3831-42d0-86ef-202bc665296f service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:31:24.247299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee0a91-3831-42d0-86ef-202bc665296f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:31:24.268882 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee0a91-3831-42d0-86ef-202bc665296f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:31:24.270451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee0a91-3831-42d0-86ef-202bc665296f service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:31:24.282888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1419/2817] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:31:26.776752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5850085-e1f4-44d8-9b55-c954326eb8c8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:31:26.777270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5850085-e1f4-44d8-9b55-c954326eb8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:31:26.777270 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5850085-e1f4-44d8-9b55-c954326eb8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:31:26.796421 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d5850085-e1f4-44d8-9b55-c954326eb8c8 None None] MFA Rules not processed for user `4c310b330d8c43e987dcd29193042c87`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:31:26.797735 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d5850085-e1f4-44d8-9b55-c954326eb8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:31:26.805504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1399/2818] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:31:34.278078 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=46 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:31:36.791649 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=52 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:31:38.198118 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee0a91-3831-42d0-86ef-202bc665296f service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:31:38.199629 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9aee0a91-3831-42d0-86ef-202bc665296f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:31:38.215593 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee0a91-3831-42d0-86ef-202bc665296f service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:31:38.223544 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86d968-2ea8-47eb-9fec-1ac6ccca262b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:31:38.224336 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86d968-2ea8-47eb-9fec-1ac6ccca262b service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:31:38.224683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86d968-2ea8-47eb-9fec-1ac6ccca262b service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:31:38.225016 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86d968-2ea8-47eb-9fec-1ac6ccca262b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:31:38.226806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-fe86d968-2ea8-47eb-9fec-1ac6ccca262b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:31:38.239473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86d968-2ea8-47eb-9fec-1ac6ccca262b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:31:38.241048 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86d968-2ea8-47eb-9fec-1ac6ccca262b service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:31:38.252391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1420/2819] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:31:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:31:48.247847 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=6 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:26.194904 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5850085-e1f4-44d8-9b55-c954326eb8c8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:26.197603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d5850085-e1f4-44d8-9b55-c954326eb8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:26.305254 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5850085-e1f4-44d8-9b55-c954326eb8c8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:26.310326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:26.310959 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:26.311279 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:26.311551 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] PATH_INFO: `/v3/users/4c310b330d8c43e987dcd29193042c87` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:26.313292 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c310b330d8c43e987dcd29193042c87)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:26.316303 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:26.374116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c310b330d8c43e987dcd29193042c87'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:26.392133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c310b330d8c43e987dcd29193042c87'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:26.394818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c310b330d8c43e987dcd29193042c87'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:26.395573 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c310b330d8c43e987dcd29193042c87'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:26.396206 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-89297d9a-5e7d-46be-b75f-8c20a8c8d6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c310b330d8c43e987dcd29193042c87'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:26.412662 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1400/2820] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:32:26 2022] DELETE /identity/v3/users/4c310b330d8c43e987dcd29193042c87 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:26.604377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86d968-2ea8-47eb-9fec-1ac6ccca262b service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:26.615323 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86d968-2ea8-47eb-9fec-1ac6ccca262b service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:26.677358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:26.677996 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:26.678281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:26.678601 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] PATH_INFO: `/v3/projects/480c2cb3ae354741938d9eaa6e2a9fcb` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:26.679765 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480c2cb3ae354741938d9eaa6e2a9fcb)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:26.681741 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:26.733777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480c2cb3ae354741938d9eaa6e2a9fcb', 'request_id': 'req-aa2610e7-4555-495c-a637-6e7e8401daa2'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:26.742801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480c2cb3ae354741938d9eaa6e2a9fcb', 'request_id': 'req-aa2610e7-4555-495c-a637-6e7e8401daa2'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:26.749488 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480c2cb3ae354741938d9eaa6e2a9fcb', 'request_id': 'req-aa2610e7-4555-495c-a637-6e7e8401daa2'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:26.760805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] The token cache is being invalidate because project 480c2cb3ae354741938d9eaa6e2a9fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:32:26.761087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:26.761733 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-aa2610e7-4555-495c-a637-6e7e8401daa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:26.763391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1421/2821] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:32:26 2022] DELETE /identity/v3/projects/480c2cb3ae354741938d9eaa6e2a9fcb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:26.768439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbd5d0-13cf-4158-9fc3-36b8e1c1c2ed None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:26.768719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbd5d0-13cf-4158-9fc3-36b8e1c1c2ed None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:26.768987 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbd5d0-13cf-4158-9fc3-36b8e1c1c2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:26.817774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-82bbd5d0-13cf-4158-9fc3-36b8e1c1c2ed None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:26.819018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-82bbd5d0-13cf-4158-9fc3-36b8e1c1c2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:26.846696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:26.883296 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1401/2822] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:26.891207 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616a2ed-221f-467b-83b5-01aded2cc2fa None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:26.891528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616a2ed-221f-467b-83b5-01aded2cc2fa None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:26.891808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616a2ed-221f-467b-83b5-01aded2cc2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:26.913399 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e616a2ed-221f-467b-83b5-01aded2cc2fa None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:26.914609 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e616a2ed-221f-467b-83b5-01aded2cc2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:26.923887 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1422/2823] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:26.928190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbd5d0-13cf-4158-9fc3-36b8e1c1c2ed None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:26.938469 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbd5d0-13cf-4158-9fc3-36b8e1c1c2ed None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:26.945099 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4eabe-fcc7-407a-8d02-6699549fea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:26.945708 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4eabe-fcc7-407a-8d02-6699549fea17 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:26.945981 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4eabe-fcc7-407a-8d02-6699549fea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:26.946245 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4eabe-fcc7-407a-8d02-6699549fea17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:26.947021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4eabe-fcc7-407a-8d02-6699549fea17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:32:26.947345 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4eabe-fcc7-407a-8d02-6699549fea17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:26.948917 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4eabe-fcc7-407a-8d02-6699549fea17 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:26.960983 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1402/2824] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:32:26.965872 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616a2ed-221f-467b-83b5-01aded2cc2fa None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:26.976194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616a2ed-221f-467b-83b5-01aded2cc2fa None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:26.981919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c6b9-33af-4a32-a9bd-98ff472be3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:26.982528 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c6b9-33af-4a32-a9bd-98ff472be3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:26.982827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c6b9-33af-4a32-a9bd-98ff472be3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:26.983096 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c6b9-33af-4a32-a9bd-98ff472be3b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:26.983762 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390c6b9-33af-4a32-a9bd-98ff472be3b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:26.985791 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390c6b9-33af-4a32-a9bd-98ff472be3b4 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:27.027097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1423/2825] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:32:26 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:27.031670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4eabe-fcc7-407a-8d02-6699549fea17 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:27.042342 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4eabe-fcc7-407a-8d02-6699549fea17 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:27.100880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7f9c6-281f-4a98-9954-81500203b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:27.101472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7f9c6-281f-4a98-9954-81500203b163 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:27.101752 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7f9c6-281f-4a98-9954-81500203b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:27.102013 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7f9c6-281f-4a98-9954-81500203b163 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:27.102626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7f9c6-281f-4a98-9954-81500203b163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:27.104681 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7f9c6-281f-4a98-9954-81500203b163 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:27.132191 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1403/2826] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:32:27 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:27.136617 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c6b9-33af-4a32-a9bd-98ff472be3b4 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:27.146862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c6b9-33af-4a32-a9bd-98ff472be3b4 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:27.151770 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df927d-ac99-4529-9212-525ed62a8d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:27.152434 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df927d-ac99-4529-9212-525ed62a8d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:27.152638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df927d-ac99-4529-9212-525ed62a8d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:27.152910 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df927d-ac99-4529-9212-525ed62a8d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:27.153545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df927d-ac99-4529-9212-525ed62a8d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:27.155284 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df927d-ac99-4529-9212-525ed62a8d40 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:27.170925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1424/2827] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:27.172234 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7f9c6-281f-4a98-9954-81500203b163 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:27.187528 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7f9c6-281f-4a98-9954-81500203b163 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:27.197553 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5e90d-93d0-4348-b9c5-81032a630255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:27.198976 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5e90d-93d0-4348-b9c5-81032a630255 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:27.199277 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5e90d-93d0-4348-b9c5-81032a630255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:27.199599 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5e90d-93d0-4348-b9c5-81032a630255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:27.200260 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5e90d-93d0-4348-b9c5-81032a630255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:27.201888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5e90d-93d0-4348-b9c5-81032a630255 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:27.219070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1404/2828] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:27.220299 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df927d-ac99-4529-9212-525ed62a8d40 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:27.230320 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df927d-ac99-4529-9212-525ed62a8d40 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:27.234956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af582e3-e2bb-4c8b-a97b-0642fe34ac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:27.235628 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af582e3-e2bb-4c8b-a97b-0642fe34ac2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:27.235877 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af582e3-e2bb-4c8b-a97b-0642fe34ac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:27.236149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af582e3-e2bb-4c8b-a97b-0642fe34ac2d admin admin] PATH_INFO: `/v3/projects/39a05bd4e5524ca78766d200c6b60a03/users/ea21260ff94541f091110d350822b05b/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:27.251482 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af582e3-e2bb-4c8b-a97b-0642fe34ac2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a05bd4e5524ca78766d200c6b60a03, user_id=ea21260ff94541f091110d350822b05b, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:27.254314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af582e3-e2bb-4c8b-a97b-0642fe34ac2d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:27.270226 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1425/2829] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:27 2022] PUT /identity/v3/projects/39a05bd4e5524ca78766d200c6b60a03/users/ea21260ff94541f091110d350822b05b/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:32:27.282068 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bbe0a-18f1-4e02-add3-5b1e999581d9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:27.282347 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bbe0a-18f1-4e02-add3-5b1e999581d9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:27.282612 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bbe0a-18f1-4e02-add3-5b1e999581d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:27.311872 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fc8bbe0a-18f1-4e02-add3-5b1e999581d9 None None] MFA Rules not processed for user `ea21260ff94541f091110d350822b05b`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:27.313106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fc8bbe0a-18f1-4e02-add3-5b1e999581d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:27.380906 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1405/2830] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:27.391902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af582e3-e2bb-4c8b-a97b-0642fe34ac2d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:27.393737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9af582e3-e2bb-4c8b-a97b-0642fe34ac2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:27.420778 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:27.484691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af582e3-e2bb-4c8b-a97b-0642fe34ac2d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:27.489178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c6b8e-828f-4948-8af4-da7c10f90485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:27.489783 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c6b8e-828f-4948-8af4-da7c10f90485 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:27.490064 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c6b8e-828f-4948-8af4-da7c10f90485 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:27.490332 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c6b8e-828f-4948-8af4-da7c10f90485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:27.499395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c6b8e-828f-4948-8af4-da7c10f90485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:27.500849 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c6b8e-828f-4948-8af4-da7c10f90485 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:27.510313 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1426/2831] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:28.916561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bbe0a-18f1-4e02-add3-5b1e999581d9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:28.918165 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fc8bbe0a-18f1-4e02-add3-5b1e999581d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:28.931126 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bbe0a-18f1-4e02-add3-5b1e999581d9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:28.935275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf823552-b37e-4fb1-88c9-e1e9435b071d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:28.935893 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf823552-b37e-4fb1-88c9-e1e9435b071d service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:28.936170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf823552-b37e-4fb1-88c9-e1e9435b071d service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:28.936442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf823552-b37e-4fb1-88c9-e1e9435b071d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:28.938228 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cf823552-b37e-4fb1-88c9-e1e9435b071d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:28.960778 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:29.012702 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf823552-b37e-4fb1-88c9-e1e9435b071d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:29.014183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf823552-b37e-4fb1-88c9-e1e9435b071d service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:29.025406 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1406/2832] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:30.443516 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c6b8e-828f-4948-8af4-da7c10f90485 service cinder] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:30.454615 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c6b8e-828f-4948-8af4-da7c10f90485 service cinder] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:30.459059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac78c8-e92d-4adc-ada0-e4b96cc7a298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:30.459687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac78c8-e92d-4adc-ada0-e4b96cc7a298 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:30.459965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac78c8-e92d-4adc-ada0-e4b96cc7a298 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:30.460236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac78c8-e92d-4adc-ada0-e4b96cc7a298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:30.462077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-bdac78c8-e92d-4adc-ada0-e4b96cc7a298 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:30.476599 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac78c8-e92d-4adc-ada0-e4b96cc7a298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:30.478033 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac78c8-e92d-4adc-ada0-e4b96cc7a298 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:30.489503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1427/2833] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:36.244603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf823552-b37e-4fb1-88c9-e1e9435b071d service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:36.318246 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf823552-b37e-4fb1-88c9-e1e9435b071d service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:36.323284 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:36.323925 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:36.324203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:36.324472 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] PATH_INFO: `/v3/users/ea21260ff94541f091110d350822b05b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:36.325766 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea21260ff94541f091110d350822b05b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:36.328032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:36.385492 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea21260ff94541f091110d350822b05b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:36.398404 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea21260ff94541f091110d350822b05b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:36.405458 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea21260ff94541f091110d350822b05b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:36.406213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea21260ff94541f091110d350822b05b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:36.406848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea21260ff94541f091110d350822b05b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:36.421709 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1407/2834] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:32:36 2022] DELETE /identity/v3/users/ea21260ff94541f091110d350822b05b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:36.426424 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502be14-f852-448d-bb14-7cb94b91e663 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:36.426935 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502be14-f852-448d-bb14-7cb94b91e663 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:36.427051 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502be14-f852-448d-bb14-7cb94b91e663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:36.446667 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-8502be14-f852-448d-bb14-7cb94b91e663 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:36.447909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8502be14-f852-448d-bb14-7cb94b91e663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:36.531463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1428/2835] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:36.541664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:36.543124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:36.578761 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:36.605920 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fc927-2966-4789-af7d-5b1a2eca2cbb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:36.610396 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefc643-8c49-4532-90b0-7976adf448a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:36.610994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefc643-8c49-4532-90b0-7976adf448a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:36.611232 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefc643-8c49-4532-90b0-7976adf448a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:36.611556 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefc643-8c49-4532-90b0-7976adf448a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:36.624225 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefc643-8c49-4532-90b0-7976adf448a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:36.625707 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefc643-8c49-4532-90b0-7976adf448a8 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:36.635714 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1408/2836] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:32:36.930303 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502be14-f852-448d-bb14-7cb94b91e663 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:36.931859 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-8502be14-f852-448d-bb14-7cb94b91e663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:36.944975 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502be14-f852-448d-bb14-7cb94b91e663 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:36.950209 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:36.950978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:36.951268 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:36.951612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] PATH_INFO: `/v3/projects/39a05bd4e5524ca78766d200c6b60a03` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:36.953105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a05bd4e5524ca78766d200c6b60a03)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:36.954870 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.002619 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a05bd4e5524ca78766d200c6b60a03', 'request_id': 'req-dbba966a-cdee-490c-9a48-82112cbdb16c'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:37.011812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a05bd4e5524ca78766d200c6b60a03', 'request_id': 'req-dbba966a-cdee-490c-9a48-82112cbdb16c'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:37.018223 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a05bd4e5524ca78766d200c6b60a03', 'request_id': 'req-dbba966a-cdee-490c-9a48-82112cbdb16c'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:37.028437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] The token cache is being invalidate because project 39a05bd4e5524ca78766d200c6b60a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:32:37.028801 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:37.029470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-dbba966a-cdee-490c-9a48-82112cbdb16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:37.031011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1429/2837] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:32:36 2022] DELETE /identity/v3/projects/39a05bd4e5524ca78766d200c6b60a03 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:37.035991 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d44524-c0c9-456c-a8b6-c7090b047a4b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.036273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d44524-c0c9-456c-a8b6-c7090b047a4b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.036550 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d44524-c0c9-456c-a8b6-c7090b047a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.058887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d4d44524-c0c9-456c-a8b6-c7090b047a4b None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:37.060188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d4d44524-c0c9-456c-a8b6-c7090b047a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:37.125858 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1409/2838] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:37.137855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75c80-0946-4984-80fc-a7f114382c06 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.138165 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75c80-0946-4984-80fc-a7f114382c06 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.138611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75c80-0946-4984-80fc-a7f114382c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.159760 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-aaa75c80-0946-4984-80fc-a7f114382c06 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:37.160970 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-aaa75c80-0946-4984-80fc-a7f114382c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:37.172009 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1430/2839] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:37.176448 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d44524-c0c9-456c-a8b6-c7090b047a4b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.186907 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d44524-c0c9-456c-a8b6-c7090b047a4b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.192623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6462f-7353-4a0c-a7d4-aeef81d99313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.193227 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6462f-7353-4a0c-a7d4-aeef81d99313 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.193499 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6462f-7353-4a0c-a7d4-aeef81d99313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.193764 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6462f-7353-4a0c-a7d4-aeef81d99313 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.194410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6462f-7353-4a0c-a7d4-aeef81d99313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:32:37.194706 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6462f-7353-4a0c-a7d4-aeef81d99313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.196322 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6462f-7353-4a0c-a7d4-aeef81d99313 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.209242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1410/2840] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:32:37.213789 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa75c80-0946-4984-80fc-a7f114382c06 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.219860 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:37.223947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa75c80-0946-4984-80fc-a7f114382c06 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.230663 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b06ea7-4baf-4a4c-a8f4-a24d1fb7c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.231283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b06ea7-4baf-4a4c-a8f4-a24d1fb7c260 admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.231775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b06ea7-4baf-4a4c-a8f4-a24d1fb7c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.232093 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b06ea7-4baf-4a4c-a8f4-a24d1fb7c260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.233063 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b06ea7-4baf-4a4c-a8f4-a24d1fb7c260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.235282 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b06ea7-4baf-4a4c-a8f4-a24d1fb7c260 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.266403 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1431/2841] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:32:37 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:37.270868 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6462f-7353-4a0c-a7d4-aeef81d99313 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.281619 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6462f-7353-4a0c-a7d4-aeef81d99313 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.339390 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58f2e-bc85-4df1-910d-bb6ae5f335f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.339986 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58f2e-bc85-4df1-910d-bb6ae5f335f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.340259 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58f2e-bc85-4df1-910d-bb6ae5f335f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.340525 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58f2e-bc85-4df1-910d-bb6ae5f335f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.341175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e58f2e-bc85-4df1-910d-bb6ae5f335f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.343153 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e58f2e-bc85-4df1-910d-bb6ae5f335f2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.369168 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1411/2842] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:32:37 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:37.373660 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b06ea7-4baf-4a4c-a8f4-a24d1fb7c260 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.383864 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b06ea7-4baf-4a4c-a8f4-a24d1fb7c260 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.388563 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c7df-77b3-4784-8d78-619129a9d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.389178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c7df-77b3-4784-8d78-619129a9d494 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.389450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c7df-77b3-4784-8d78-619129a9d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.389718 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c7df-77b3-4784-8d78-619129a9d494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.390358 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67c7df-77b3-4784-8d78-619129a9d494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.391989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67c7df-77b3-4784-8d78-619129a9d494 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.401919 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1432/2843] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:37.406252 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58f2e-bc85-4df1-910d-bb6ae5f335f2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.416604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58f2e-bc85-4df1-910d-bb6ae5f335f2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.421729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f0d4b-6953-496d-b66c-fed89c7b7287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.422352 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0d4b-6953-496d-b66c-fed89c7b7287 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.422633 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0d4b-6953-496d-b66c-fed89c7b7287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.422902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0d4b-6953-496d-b66c-fed89c7b7287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.423570 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f0d4b-6953-496d-b66c-fed89c7b7287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.425143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f0d4b-6953-496d-b66c-fed89c7b7287 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.435958 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1412/2844] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:37.439979 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c7df-77b3-4784-8d78-619129a9d494 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.450908 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c7df-77b3-4784-8d78-619129a9d494 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.456258 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5b00f-3065-49f0-b15c-7577bb182320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.456901 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5b00f-3065-49f0-b15c-7577bb182320 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.457179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5b00f-3065-49f0-b15c-7577bb182320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.457450 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5b00f-3065-49f0-b15c-7577bb182320 admin admin] PATH_INFO: `/v3/projects/ef7a7c56c196497b811aa305cfc518d4/users/2f265f34ae9c43dc9e3b9b47d914c655/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.472335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5b00f-3065-49f0-b15c-7577bb182320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7a7c56c196497b811aa305cfc518d4, user_id=2f265f34ae9c43dc9e3b9b47d914c655, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.474976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5b00f-3065-49f0-b15c-7577bb182320 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.490577 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1433/2845] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:37 2022] PUT /identity/v3/projects/ef7a7c56c196497b811aa305cfc518d4/users/2f265f34ae9c43dc9e3b9b47d914c655/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:37.501386 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8091a0-3726-4a71-b0e4-35a3e1d45c85 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.501791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8091a0-3726-4a71-b0e4-35a3e1d45c85 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.502069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8091a0-3726-4a71-b0e4-35a3e1d45c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.533724 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7d8091a0-3726-4a71-b0e4-35a3e1d45c85 None None] MFA Rules not processed for user `2f265f34ae9c43dc9e3b9b47d914c655`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:37.534963 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7d8091a0-3726-4a71-b0e4-35a3e1d45c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:37.564969 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:37.608451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1413/2846] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:37.613168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5b00f-3065-49f0-b15c-7577bb182320 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.678834 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5b00f-3065-49f0-b15c-7577bb182320 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.684665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126284a-8d09-4d96-8d81-b471643ee73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.685270 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126284a-8d09-4d96-8d81-b471643ee73b admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.685547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126284a-8d09-4d96-8d81-b471643ee73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.685808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126284a-8d09-4d96-8d81-b471643ee73b admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.686476 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126284a-8d09-4d96-8d81-b471643ee73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.688417 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126284a-8d09-4d96-8d81-b471643ee73b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.717669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1434/2847] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:32:37 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:37.721785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8091a0-3726-4a71-b0e4-35a3e1d45c85 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.732816 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8091a0-3726-4a71-b0e4-35a3e1d45c85 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.790473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4346261-6d4a-49cf-91d0-6951d9aa8838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.791106 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4346261-6d4a-49cf-91d0-6951d9aa8838 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.791397 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4346261-6d4a-49cf-91d0-6951d9aa8838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.791670 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4346261-6d4a-49cf-91d0-6951d9aa8838 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.792287 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4346261-6d4a-49cf-91d0-6951d9aa8838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.794184 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4346261-6d4a-49cf-91d0-6951d9aa8838 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.817667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1414/2848] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:32:37 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:37.821795 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126284a-8d09-4d96-8d81-b471643ee73b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.832957 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126284a-8d09-4d96-8d81-b471643ee73b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.838569 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e460b-ccc1-4e01-bd47-e8b6f5a425ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.839162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e460b-ccc1-4e01-bd47-e8b6f5a425ef admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.839484 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e460b-ccc1-4e01-bd47-e8b6f5a425ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.839750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e460b-ccc1-4e01-bd47-e8b6f5a425ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.840419 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e460b-ccc1-4e01-bd47-e8b6f5a425ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.842095 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e460b-ccc1-4e01-bd47-e8b6f5a425ef admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.852904 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1435/2849] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:37.857372 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4346261-6d4a-49cf-91d0-6951d9aa8838 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.867882 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4346261-6d4a-49cf-91d0-6951d9aa8838 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.874200 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25147c-536a-44ec-9992-8422f99b5ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.874856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25147c-536a-44ec-9992-8422f99b5ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.875134 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25147c-536a-44ec-9992-8422f99b5ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.875438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25147c-536a-44ec-9992-8422f99b5ab4 admin admin] PATH_INFO: `/v3/projects/280d7b47cb064f819d63c60548329dff/users/cb4daafafb7448268e39feb330ff2356/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.890218 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25147c-536a-44ec-9992-8422f99b5ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280d7b47cb064f819d63c60548329dff, user_id=cb4daafafb7448268e39feb330ff2356, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.892901 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25147c-536a-44ec-9992-8422f99b5ab4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.907935 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1415/2850] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:37 2022] PUT /identity/v3/projects/280d7b47cb064f819d63c60548329dff/users/cb4daafafb7448268e39feb330ff2356/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:37.912003 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e460b-ccc1-4e01-bd47-e8b6f5a425ef admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:37.922558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e460b-ccc1-4e01-bd47-e8b6f5a425ef admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:37.980296 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0980123-3849-4759-b3b7-9cd8a2c62346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:37.980830 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980123-3849-4759-b3b7-9cd8a2c62346 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:37.981106 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980123-3849-4759-b3b7-9cd8a2c62346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:37.981377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980123-3849-4759-b3b7-9cd8a2c62346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:37.982039 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0980123-3849-4759-b3b7-9cd8a2c62346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:37.983862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0980123-3849-4759-b3b7-9cd8a2c62346 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:37.994449 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1436/2851] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:38.000120 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25147c-536a-44ec-9992-8422f99b5ab4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:38.010795 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25147c-536a-44ec-9992-8422f99b5ab4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:38.016027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6782e-2e3f-4ccf-8e25-57cbb6b234e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:38.016672 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6782e-2e3f-4ccf-8e25-57cbb6b234e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:38.016943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6782e-2e3f-4ccf-8e25-57cbb6b234e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:38.017209 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6782e-2e3f-4ccf-8e25-57cbb6b234e6 admin admin] PATH_INFO: `/v3/projects/280d7b47cb064f819d63c60548329dff/users/cb4daafafb7448268e39feb330ff2356/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:38.019139 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6782e-2e3f-4ccf-8e25-57cbb6b234e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280d7b47cb064f819d63c60548329dff, user_id=cb4daafafb7448268e39feb330ff2356, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:38.021880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6782e-2e3f-4ccf-8e25-57cbb6b234e6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:38.032135 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1416/2852] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:37 2022] PUT /identity/v3/projects/280d7b47cb064f819d63c60548329dff/users/cb4daafafb7448268e39feb330ff2356/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:32:38.098451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92adb5-d916-485b-8900-76709dde0164 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:38.098727 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92adb5-d916-485b-8900-76709dde0164 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:38.099004 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92adb5-d916-485b-8900-76709dde0164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:38.128361 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-fa92adb5-d916-485b-8900-76709dde0164 None None] MFA Rules not processed for user `cb4daafafb7448268e39feb330ff2356`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:38.129595 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-fa92adb5-d916-485b-8900-76709dde0164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:38.134954 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:38.200852 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1437/2853] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:38.213146 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6782e-2e3f-4ccf-8e25-57cbb6b234e6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:38.215173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-58f6782e-2e3f-4ccf-8e25-57cbb6b234e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:38.286484 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6782e-2e3f-4ccf-8e25-57cbb6b234e6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:38.290760 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12bba7-952b-460a-8855-b9e9d73d40e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:38.291400 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12bba7-952b-460a-8855-b9e9d73d40e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:38.291686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12bba7-952b-460a-8855-b9e9d73d40e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:38.291948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12bba7-952b-460a-8855-b9e9d73d40e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:38.306442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12bba7-952b-460a-8855-b9e9d73d40e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:38.308601 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12bba7-952b-460a-8855-b9e9d73d40e9 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:38.319555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1417/2854] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:38.765437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92adb5-d916-485b-8900-76709dde0164 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:38.829342 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92adb5-d916-485b-8900-76709dde0164 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:38.835433 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:38.836072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:38.836353 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:38.836621 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] PATH_INFO: `/v3/users/2f265f34ae9c43dc9e3b9b47d914c655` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:38.837907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f265f34ae9c43dc9e3b9b47d914c655)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:38.839909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:38.900959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f265f34ae9c43dc9e3b9b47d914c655'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:38.913058 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f265f34ae9c43dc9e3b9b47d914c655'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:38.922659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f265f34ae9c43dc9e3b9b47d914c655'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:38.923411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f265f34ae9c43dc9e3b9b47d914c655'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:38.924037 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f265f34ae9c43dc9e3b9b47d914c655'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:38.940485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1438/2855] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:32:38 2022] DELETE /identity/v3/users/2f265f34ae9c43dc9e3b9b47d914c655 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:38.945274 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757bdc5-0e9c-4280-bb08-421a2b6efd06 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:38.945560 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757bdc5-0e9c-4280-bb08-421a2b6efd06 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:38.945834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757bdc5-0e9c-4280-bb08-421a2b6efd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:38.965354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7757bdc5-0e9c-4280-bb08-421a2b6efd06 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:38.966608 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7757bdc5-0e9c-4280-bb08-421a2b6efd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:38.984597 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:39.027813 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1418/2856] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:39.040082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:39.041585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:39.069427 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:39.104125 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669443f-58fe-4919-8ccb-e1c2214a8e45 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:39.108470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56750a6b-108f-4aa6-afdf-22894cd0dea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:39.109081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56750a6b-108f-4aa6-afdf-22894cd0dea9 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:39.109357 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56750a6b-108f-4aa6-afdf-22894cd0dea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:39.109625 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56750a6b-108f-4aa6-afdf-22894cd0dea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:39.120113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56750a6b-108f-4aa6-afdf-22894cd0dea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:39.122259 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56750a6b-108f-4aa6-afdf-22894cd0dea9 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:39.132726 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1439/2857] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:32:39.424791 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757bdc5-0e9c-4280-bb08-421a2b6efd06 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:39.426615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7757bdc5-0e9c-4280-bb08-421a2b6efd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:39.440834 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757bdc5-0e9c-4280-bb08-421a2b6efd06 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:39.445853 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:39.446495 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:39.446905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:39.447049 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] PATH_INFO: `/v3/projects/ef7a7c56c196497b811aa305cfc518d4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:39.448237 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7a7c56c196497b811aa305cfc518d4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:39.450213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:39.501815 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7a7c56c196497b811aa305cfc518d4', 'request_id': 'req-b08a8498-de42-476a-aafa-5cdd0e5325b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:39.512190 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7a7c56c196497b811aa305cfc518d4', 'request_id': 'req-b08a8498-de42-476a-aafa-5cdd0e5325b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:39.518871 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7a7c56c196497b811aa305cfc518d4', 'request_id': 'req-b08a8498-de42-476a-aafa-5cdd0e5325b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:39.531497 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] The token cache is being invalidate because project ef7a7c56c196497b811aa305cfc518d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:32:39.531780 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:39.532416 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:39.533931 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1419/2858] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:32:39 2022] DELETE /identity/v3/projects/ef7a7c56c196497b811aa305cfc518d4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:39.538224 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56750a6b-108f-4aa6-afdf-22894cd0dea9 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:39.548354 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56750a6b-108f-4aa6-afdf-22894cd0dea9 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:39.606612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:39.607290 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:39.607585 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:39.607931 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] PATH_INFO: `/v3/users/cb4daafafb7448268e39feb330ff2356` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:39.609088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4daafafb7448268e39feb330ff2356)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:39.611097 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:39.659198 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4daafafb7448268e39feb330ff2356'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:39.671876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4daafafb7448268e39feb330ff2356'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:39.679810 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4daafafb7448268e39feb330ff2356'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:39.680529 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4daafafb7448268e39feb330ff2356'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:39.681178 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-f8720226-f8e1-42ab-867d-7ee74f376924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4daafafb7448268e39feb330ff2356'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:39.695525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1440/2859] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:32:39 2022] DELETE /identity/v3/users/cb4daafafb7448268e39feb330ff2356 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:39.976298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:39.977892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:39.997663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8498-de42-476a-aafa-5cdd0e5325b1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:40.053943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:40.054571 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.054841 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.055107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] PATH_INFO: `/v3/projects/280d7b47cb064f819d63c60548329dff` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.056239 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=280d7b47cb064f819d63c60548329dff)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:40.058162 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:40.103926 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:40.105264 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280d7b47cb064f819d63c60548329dff', 'request_id': 'req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:40.114203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280d7b47cb064f819d63c60548329dff', 'request_id': 'req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:40.120509 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280d7b47cb064f819d63c60548329dff', 'request_id': 'req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:40.130609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] The token cache is being invalidate because project 280d7b47cb064f819d63c60548329dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:32:40.130897 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:40.131579 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e2c9db3-18f6-46be-b43a-48d0f9ce16c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:40.133073 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1420/2860] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:32:39 2022] DELETE /identity/v3/projects/280d7b47cb064f819d63c60548329dff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:40.138100 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8763-0ea9-4fdd-9372-a09bfaf44060 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.138661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8763-0ea9-4fdd-9372-a09bfaf44060 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.138838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8763-0ea9-4fdd-9372-a09bfaf44060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.159634 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-236d8763-0ea9-4fdd-9372-a09bfaf44060 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:40.160854 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-236d8763-0ea9-4fdd-9372-a09bfaf44060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:40.204267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:40.226256 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1441/2861] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:40.234394 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea493d6-19ca-4037-acce-ba86a4932853 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.234675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea493d6-19ca-4037-acce-ba86a4932853 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.234948 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea493d6-19ca-4037-acce-ba86a4932853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.255006 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-eea493d6-19ca-4037-acce-ba86a4932853 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:40.256331 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eea493d6-19ca-4037-acce-ba86a4932853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:40.265729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1421/2862] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:32:40.270229 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d8763-0ea9-4fdd-9372-a09bfaf44060 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:40.280398 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d8763-0ea9-4fdd-9372-a09bfaf44060 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:40.286317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b361560-c713-43dc-b6bb-7f26131f7c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:40.286925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b361560-c713-43dc-b6bb-7f26131f7c9e admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.287208 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b361560-c713-43dc-b6bb-7f26131f7c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.287519 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b361560-c713-43dc-b6bb-7f26131f7c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.288168 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b361560-c713-43dc-b6bb-7f26131f7c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:32:40.288474 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b361560-c713-43dc-b6bb-7f26131f7c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:40.290195 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b361560-c713-43dc-b6bb-7f26131f7c9e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:40.302156 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1442/2863] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:32:40.307220 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea493d6-19ca-4037-acce-ba86a4932853 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:40.318504 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea493d6-19ca-4037-acce-ba86a4932853 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:40.323615 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5426e-3ccf-4444-86fb-63997e1f0a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:40.324236 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5426e-3ccf-4444-86fb-63997e1f0a80 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.324510 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5426e-3ccf-4444-86fb-63997e1f0a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.324777 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5426e-3ccf-4444-86fb-63997e1f0a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.325402 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5426e-3ccf-4444-86fb-63997e1f0a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:40.327447 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5426e-3ccf-4444-86fb-63997e1f0a80 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:40.358105 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1422/2864] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:32:40 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:40.362391 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b361560-c713-43dc-b6bb-7f26131f7c9e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:40.373543 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b361560-c713-43dc-b6bb-7f26131f7c9e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:40.432878 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f602-3a23-41a2-87ca-cbb16f363e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:40.433395 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f602-3a23-41a2-87ca-cbb16f363e2c admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.433708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f602-3a23-41a2-87ca-cbb16f363e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.433969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f602-3a23-41a2-87ca-cbb16f363e2c admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.434582 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62f602-3a23-41a2-87ca-cbb16f363e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:40.436640 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62f602-3a23-41a2-87ca-cbb16f363e2c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:40.460626 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1443/2865] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:32:40 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:40.464942 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5426e-3ccf-4444-86fb-63997e1f0a80 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:40.477443 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5426e-3ccf-4444-86fb-63997e1f0a80 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:40.485946 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b1df1-dfbf-41a8-93c8-c458c50dd8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:40.486829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b1df1-dfbf-41a8-93c8-c458c50dd8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.487217 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b1df1-dfbf-41a8-93c8-c458c50dd8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.487664 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b1df1-dfbf-41a8-93c8-c458c50dd8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.488643 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b1df1-dfbf-41a8-93c8-c458c50dd8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:40.491142 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b1df1-dfbf-41a8-93c8-c458c50dd8a3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:40.504086 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1423/2866] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:40.508356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f602-3a23-41a2-87ca-cbb16f363e2c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:40.519006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f602-3a23-41a2-87ca-cbb16f363e2c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:40.524376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eee14-98cf-4f37-8d40-79c8e98611d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:40.524969 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eee14-98cf-4f37-8d40-79c8e98611d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.525255 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eee14-98cf-4f37-8d40-79c8e98611d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.525547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eee14-98cf-4f37-8d40-79c8e98611d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.526187 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eee14-98cf-4f37-8d40-79c8e98611d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:40.527821 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eee14-98cf-4f37-8d40-79c8e98611d3 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:40.538404 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1444/2867] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:32:40.542786 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b1df1-dfbf-41a8-93c8-c458c50dd8a3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:40.553638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b1df1-dfbf-41a8-93c8-c458c50dd8a3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:40.558887 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d976d6-cbf3-4a50-86a6-3d68b4e88895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:40.559561 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d976d6-cbf3-4a50-86a6-3d68b4e88895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.559818 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d976d6-cbf3-4a50-86a6-3d68b4e88895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.560083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d976d6-cbf3-4a50-86a6-3d68b4e88895 admin admin] PATH_INFO: `/v3/projects/31478b9bc8e94f5f8c5b999093caf998/users/b9228f1862bb4c769a16695ac2e7f430/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.575036 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d976d6-cbf3-4a50-86a6-3d68b4e88895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31478b9bc8e94f5f8c5b999093caf998, user_id=b9228f1862bb4c769a16695ac2e7f430, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:40.577732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d976d6-cbf3-4a50-86a6-3d68b4e88895 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:40.593173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1424/2868] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:40 2022] PUT /identity/v3/projects/31478b9bc8e94f5f8c5b999093caf998/users/b9228f1862bb4c769a16695ac2e7f430/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:40.604413 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c79575-bcde-4fb9-934e-c4693d166155 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.604799 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c79575-bcde-4fb9-934e-c4693d166155 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.605179 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c79575-bcde-4fb9-934e-c4693d166155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.641130 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-09c79575-bcde-4fb9-934e-c4693d166155 None None] MFA Rules not processed for user `b9228f1862bb4c769a16695ac2e7f430`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:40.642367 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-09c79575-bcde-4fb9-934e-c4693d166155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:40.720489 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1445/2869] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:40.724980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d976d6-cbf3-4a50-86a6-3d68b4e88895 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:40.800283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d976d6-cbf3-4a50-86a6-3d68b4e88895 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:40.805823 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72d2e0-6730-4a89-bf9a-e5be5641f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:40.806427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d2e0-6730-4a89-bf9a-e5be5641f52f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.806686 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d2e0-6730-4a89-bf9a-e5be5641f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.807004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d2e0-6730-4a89-bf9a-e5be5641f52f admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.807668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72d2e0-6730-4a89-bf9a-e5be5641f52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:40.809854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72d2e0-6730-4a89-bf9a-e5be5641f52f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:40.845533 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1425/2870] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:32:40 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:40.850725 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c79575-bcde-4fb9-934e-c4693d166155 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:40.864137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c79575-bcde-4fb9-934e-c4693d166155 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:40.905738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:40.931434 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653589c-dba8-433b-812a-1e60c7fb153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:40.932067 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653589c-dba8-433b-812a-1e60c7fb153e admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.932345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653589c-dba8-433b-812a-1e60c7fb153e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.932618 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653589c-dba8-433b-812a-1e60c7fb153e admin admin] PATH_INFO: `/v3/users` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.933236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653589c-dba8-433b-812a-1e60c7fb153e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:40.935181 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653589c-dba8-433b-812a-1e60c7fb153e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:40.963314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1446/2871] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:32:40 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:40.967637 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72d2e0-6730-4a89-bf9a-e5be5641f52f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:40.979539 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72d2e0-6730-4a89-bf9a-e5be5641f52f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:40.985172 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219601-69a1-491f-90ec-02bc6b05f05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:40.985774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219601-69a1-491f-90ec-02bc6b05f05e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:40.986064 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219601-69a1-491f-90ec-02bc6b05f05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:40.986335 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219601-69a1-491f-90ec-02bc6b05f05e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:40.986985 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219601-69a1-491f-90ec-02bc6b05f05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:40.988640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219601-69a1-491f-90ec-02bc6b05f05e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:40.999558 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1426/2872] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:32:41.003862 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653589c-dba8-433b-812a-1e60c7fb153e admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:41.014728 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653589c-dba8-433b-812a-1e60c7fb153e admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:41.020222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f66b-8374-435f-9b94-3bb9b70d1ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:41.020902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f66b-8374-435f-9b94-3bb9b70d1ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:41.021190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f66b-8374-435f-9b94-3bb9b70d1ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:41.021463 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f66b-8374-435f-9b94-3bb9b70d1ce9 admin admin] PATH_INFO: `/v3/projects/6c2b13d8e21047389a5aacad239b881c/users/3b06ec20030442a69902a8fe9259570e/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:41.037423 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7f66b-8374-435f-9b94-3bb9b70d1ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2b13d8e21047389a5aacad239b881c, user_id=3b06ec20030442a69902a8fe9259570e, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:41.040149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7f66b-8374-435f-9b94-3bb9b70d1ce9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:41.055806 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1447/2873] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:41 2022] PUT /identity/v3/projects/6c2b13d8e21047389a5aacad239b881c/users/3b06ec20030442a69902a8fe9259570e/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:41.059905 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219601-69a1-491f-90ec-02bc6b05f05e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:41.070032 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219601-69a1-491f-90ec-02bc6b05f05e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:41.113667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:41.128801 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48775c-3bb4-433a-87f7-8c99f5a358e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:41.129441 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48775c-3bb4-433a-87f7-8c99f5a358e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:41.129721 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48775c-3bb4-433a-87f7-8c99f5a358e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:41.129992 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48775c-3bb4-433a-87f7-8c99f5a358e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:41.130632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48775c-3bb4-433a-87f7-8c99f5a358e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:41.132293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48775c-3bb4-433a-87f7-8c99f5a358e7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:41.142070 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1427/2874] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:41.146600 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f66b-8374-435f-9b94-3bb9b70d1ce9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:41.158086 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f66b-8374-435f-9b94-3bb9b70d1ce9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:41.163871 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d9f0-3ab4-4f12-8995-34a60f61cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:41.164525 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d9f0-3ab4-4f12-8995-34a60f61cd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:41.164802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d9f0-3ab4-4f12-8995-34a60f61cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:41.165072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d9f0-3ab4-4f12-8995-34a60f61cd43 admin admin] PATH_INFO: `/v3/projects/6c2b13d8e21047389a5aacad239b881c/users/3b06ec20030442a69902a8fe9259570e/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:41.167196 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7d9f0-3ab4-4f12-8995-34a60f61cd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2b13d8e21047389a5aacad239b881c, user_id=3b06ec20030442a69902a8fe9259570e, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:41.169973 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7d9f0-3ab4-4f12-8995-34a60f61cd43 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:41.181267 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1448/2875] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:41 2022] PUT /identity/v3/projects/6c2b13d8e21047389a5aacad239b881c/users/3b06ec20030442a69902a8fe9259570e/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:41.193319 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84d8ed-4132-46a5-a672-7fae3fec7dfe None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:41.193611 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84d8ed-4132-46a5-a672-7fae3fec7dfe None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:41.193890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84d8ed-4132-46a5-a672-7fae3fec7dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:41.223451 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fb84d8ed-4132-46a5-a672-7fae3fec7dfe None None] MFA Rules not processed for user `3b06ec20030442a69902a8fe9259570e`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:41.224663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fb84d8ed-4132-46a5-a672-7fae3fec7dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:41.293426 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1428/2876] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:41.304452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d9f0-3ab4-4f12-8995-34a60f61cd43 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:41.306234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-1fa7d9f0-3ab4-4f12-8995-34a60f61cd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:41.366714 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d9f0-3ab4-4f12-8995-34a60f61cd43 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:41.371026 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6622725-562c-4654-85eb-3fcd5e74e066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:41.371659 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6622725-562c-4654-85eb-3fcd5e74e066 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:41.371943 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6622725-562c-4654-85eb-3fcd5e74e066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:41.372215 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6622725-562c-4654-85eb-3fcd5e74e066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:41.381382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6622725-562c-4654-85eb-3fcd5e74e066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:41.382835 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6622725-562c-4654-85eb-3fcd5e74e066 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:41.392642 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1449/2877] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:42.852632 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84d8ed-4132-46a5-a672-7fae3fec7dfe None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:42.926994 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84d8ed-4132-46a5-a672-7fae3fec7dfe None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:42.933085 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:42.933932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:42.934399 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:42.934863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] PATH_INFO: `/v3/users/b9228f1862bb4c769a16695ac2e7f430` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:42.937747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9228f1862bb4c769a16695ac2e7f430)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:42.940083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:43.017527 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9228f1862bb4c769a16695ac2e7f430'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.032574 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9228f1862bb4c769a16695ac2e7f430'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.040410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:43.044473 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9228f1862bb4c769a16695ac2e7f430'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.046271 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9228f1862bb4c769a16695ac2e7f430'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.048381 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9228f1862bb4c769a16695ac2e7f430'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.080530 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1429/2878] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:32:42 2022] DELETE /identity/v3/users/b9228f1862bb4c769a16695ac2e7f430 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:43.082345 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967364a-b604-41e9-ad21-3fd4246a7d72 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:43.082821 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967364a-b604-41e9-ad21-3fd4246a7d72 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:43.082964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967364a-b604-41e9-ad21-3fd4246a7d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:43.113050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-7967364a-b604-41e9-ad21-3fd4246a7d72 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:43.114382 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7967364a-b604-41e9-ad21-3fd4246a7d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:43.206344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1450/2879] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:43.218059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:43.220062 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:43.289408 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa44455-28ec-40dd-8d75-033fc1a890ac admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:43.293028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3510-e228-471b-96b8-418ffa0892ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:43.293713 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3510-e228-471b-96b8-418ffa0892ae service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:43.294075 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3510-e228-471b-96b8-418ffa0892ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:43.294407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3510-e228-471b-96b8-418ffa0892ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:43.303962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c3510-e228-471b-96b8-418ffa0892ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:43.305617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c3510-e228-471b-96b8-418ffa0892ae service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:43.315607 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1430/2880] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:43.591380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967364a-b604-41e9-ad21-3fd4246a7d72 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:43.592888 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-7967364a-b604-41e9-ad21-3fd4246a7d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:43.617898 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967364a-b604-41e9-ad21-3fd4246a7d72 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:43.622956 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:43.623787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:43.624119 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:43.624398 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] PATH_INFO: `/v3/projects/31478b9bc8e94f5f8c5b999093caf998` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:43.625559 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31478b9bc8e94f5f8c5b999093caf998)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:43.627522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:43.667459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:43.683456 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31478b9bc8e94f5f8c5b999093caf998', 'request_id': 'req-9496ceee-326b-45f8-a700-50180deb97f2'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.693279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31478b9bc8e94f5f8c5b999093caf998', 'request_id': 'req-9496ceee-326b-45f8-a700-50180deb97f2'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.699899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31478b9bc8e94f5f8c5b999093caf998', 'request_id': 'req-9496ceee-326b-45f8-a700-50180deb97f2'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.710827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] The token cache is being invalidate because project 31478b9bc8e94f5f8c5b999093caf998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:32:43.711236 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.712167 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.714055 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1451/2881] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:32:43 2022] DELETE /identity/v3/projects/31478b9bc8e94f5f8c5b999093caf998 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:43.718281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3510-e228-471b-96b8-418ffa0892ae service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:43.728769 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3510-e228-471b-96b8-418ffa0892ae service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:43.791734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:43.792382 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:43.792660 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:43.792930 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] PATH_INFO: `/v3/users/3b06ec20030442a69902a8fe9259570e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:43.794173 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b06ec20030442a69902a8fe9259570e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:43.796889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:43.848916 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b06ec20030442a69902a8fe9259570e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.861242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b06ec20030442a69902a8fe9259570e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.868262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b06ec20030442a69902a8fe9259570e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.869023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b06ec20030442a69902a8fe9259570e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.869638 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0662af87-df11-4879-ae45-b9e90930a9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b06ec20030442a69902a8fe9259570e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:43.884440 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1431/2882] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:32:43 2022] DELETE /identity/v3/users/3b06ec20030442a69902a8fe9259570e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:44.233297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:44.234807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:44.247648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496ceee-326b-45f8-a700-50180deb97f2 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:44.319047 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:44.319757 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:44.320069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:44.320285 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] PATH_INFO: `/v3/projects/6c2b13d8e21047389a5aacad239b881c` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:44.321881 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2b13d8e21047389a5aacad239b881c)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:44.324060 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:44.377101 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2b13d8e21047389a5aacad239b881c', 'request_id': 'req-b028124f-21d9-4bb8-951b-487bfae085e5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:44.384964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2b13d8e21047389a5aacad239b881c', 'request_id': 'req-b028124f-21d9-4bb8-951b-487bfae085e5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:44.391708 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2b13d8e21047389a5aacad239b881c', 'request_id': 'req-b028124f-21d9-4bb8-951b-487bfae085e5'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:44.402266 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] The token cache is being invalidate because project 6c2b13d8e21047389a5aacad239b881c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:32:44.402675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:44.403379 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-b028124f-21d9-4bb8-951b-487bfae085e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:44.408438 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1452/2883] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:32:44 2022] DELETE /identity/v3/projects/6c2b13d8e21047389a5aacad239b881c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:44.410542 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2109e72-d20c-460b-a7d5-38df08365eca None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:44.410850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2109e72-d20c-460b-a7d5-38df08365eca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:44.411123 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2109e72-d20c-460b-a7d5-38df08365eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:44.432207 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f2109e72-d20c-460b-a7d5-38df08365eca None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:44.433478 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f2109e72-d20c-460b-a7d5-38df08365eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:44.438751 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:44.500577 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1432/2884] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 01:32:44.508673 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986a8ff-c399-4da2-bb20-e6a994d212d9 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:44.508983 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986a8ff-c399-4da2-bb20-e6a994d212d9 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:44.509257 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986a8ff-c399-4da2-bb20-e6a994d212d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:44.531539 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-e986a8ff-c399-4da2-bb20-e6a994d212d9 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:44.532766 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e986a8ff-c399-4da2-bb20-e6a994d212d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:44.540689 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1453/2885] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:44.545312 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2109e72-d20c-460b-a7d5-38df08365eca None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:44.555651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2109e72-d20c-460b-a7d5-38df08365eca None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:44.560730 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b704fe-ee9e-4c1e-882b-3ac4b5e1eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:44.561566 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b704fe-ee9e-4c1e-882b-3ac4b5e1eeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:44.561747 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b704fe-ee9e-4c1e-882b-3ac4b5e1eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:44.562059 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b704fe-ee9e-4c1e-882b-3ac4b5e1eeb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:44.563342 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b704fe-ee9e-4c1e-882b-3ac4b5e1eeb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:32:44.563342 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b704fe-ee9e-4c1e-882b-3ac4b5e1eeb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:44.564785 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b704fe-ee9e-4c1e-882b-3ac4b5e1eeb8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:44.577978 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1433/2886] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:32:44.582669 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986a8ff-c399-4da2-bb20-e6a994d212d9 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:44.592925 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986a8ff-c399-4da2-bb20-e6a994d212d9 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:44.598210 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bb0c7-6897-4aa2-98a4-434efffc171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:44.598986 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bb0c7-6897-4aa2-98a4-434efffc171f admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:44.599292 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bb0c7-6897-4aa2-98a4-434efffc171f admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:44.599561 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bb0c7-6897-4aa2-98a4-434efffc171f admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:44.600162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bb0c7-6897-4aa2-98a4-434efffc171f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:44.602074 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bb0c7-6897-4aa2-98a4-434efffc171f admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:44.639042 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1454/2887] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:32:44 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:32:44.640004 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b704fe-ee9e-4c1e-882b-3ac4b5e1eeb8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:44.650933 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b704fe-ee9e-4c1e-882b-3ac4b5e1eeb8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:44.717217 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633304ad-5eb6-4f1f-bed1-18d817edbe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:44.718053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633304ad-5eb6-4f1f-bed1-18d817edbe68 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:44.718321 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633304ad-5eb6-4f1f-bed1-18d817edbe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:44.719017 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633304ad-5eb6-4f1f-bed1-18d817edbe68 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:44.719407 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633304ad-5eb6-4f1f-bed1-18d817edbe68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:44.721514 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633304ad-5eb6-4f1f-bed1-18d817edbe68 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:44.745364 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1434/2888] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:32:44 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:32:44.749687 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bb0c7-6897-4aa2-98a4-434efffc171f admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:44.761317 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bb0c7-6897-4aa2-98a4-434efffc171f admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:44.766781 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2fce0-81f8-4d94-879e-7305d4a5a265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:44.767451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2fce0-81f8-4d94-879e-7305d4a5a265 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:44.767737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2fce0-81f8-4d94-879e-7305d4a5a265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:44.768019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2fce0-81f8-4d94-879e-7305d4a5a265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:44.768664 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2fce0-81f8-4d94-879e-7305d4a5a265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:44.770290 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2fce0-81f8-4d94-879e-7305d4a5a265 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:44.781343 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1455/2889] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:32:44.785879 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633304ad-5eb6-4f1f-bed1-18d817edbe68 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:44.797030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633304ad-5eb6-4f1f-bed1-18d817edbe68 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:44.801943 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf1d60-e665-4f4e-90dd-d81601b45010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:44.802719 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf1d60-e665-4f4e-90dd-d81601b45010 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:44.803076 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf1d60-e665-4f4e-90dd-d81601b45010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:44.803442 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf1d60-e665-4f4e-90dd-d81601b45010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:44.804154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf1d60-e665-4f4e-90dd-d81601b45010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:44.805807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf1d60-e665-4f4e-90dd-d81601b45010 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:44.820346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1435/2890] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:44.821056 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2fce0-81f8-4d94-879e-7305d4a5a265 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:44.831934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2fce0-81f8-4d94-879e-7305d4a5a265 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:44.836905 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc8cac-285d-4fd5-b830-c389e834d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:44.837580 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc8cac-285d-4fd5-b830-c389e834d788 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:44.837866 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc8cac-285d-4fd5-b830-c389e834d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:44.838152 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc8cac-285d-4fd5-b830-c389e834d788 admin admin] PATH_INFO: `/v3/projects/0d76e41f825d449099d78e56daed2bf0/users/cc3963c9a35047f08a69dd418c9b6ca4/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:44.843300 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:44.855594 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc8cac-285d-4fd5-b830-c389e834d788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d76e41f825d449099d78e56daed2bf0, user_id=cc3963c9a35047f08a69dd418c9b6ca4, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:44.869678 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc8cac-285d-4fd5-b830-c389e834d788 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:44.888775 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1456/2891] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:44 2022] PUT /identity/v3/projects/0d76e41f825d449099d78e56daed2bf0/users/cc3963c9a35047f08a69dd418c9b6ca4/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:32:44.901516 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607040e-3cbb-46a0-85bd-24aa3908e830 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:44.901924 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607040e-3cbb-46a0-85bd-24aa3908e830 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:44.902193 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607040e-3cbb-46a0-85bd-24aa3908e830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:44.933865 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7607040e-3cbb-46a0-85bd-24aa3908e830 None None] MFA Rules not processed for user `cc3963c9a35047f08a69dd418c9b6ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:44.935203 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7607040e-3cbb-46a0-85bd-24aa3908e830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:45.017636 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1436/2892] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:45.022326 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc8cac-285d-4fd5-b830-c389e834d788 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:45.089964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc8cac-285d-4fd5-b830-c389e834d788 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:45.094855 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f53ada-f3bb-4183-bab8-23fe70fc816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:45.095468 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f53ada-f3bb-4183-bab8-23fe70fc816d admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:45.095786 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f53ada-f3bb-4183-bab8-23fe70fc816d admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:45.096030 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f53ada-f3bb-4183-bab8-23fe70fc816d admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:45.096776 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f53ada-f3bb-4183-bab8-23fe70fc816d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:45.098567 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f53ada-f3bb-4183-bab8-23fe70fc816d admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:45.128648 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1457/2893] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:32:45 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:32:45.132787 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607040e-3cbb-46a0-85bd-24aa3908e830 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:45.139639 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:45.144302 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607040e-3cbb-46a0-85bd-24aa3908e830 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:45.209774 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1094fb-2d04-4d0c-ba02-611d87f35e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:45.210438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1094fb-2d04-4d0c-ba02-611d87f35e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:45.210668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1094fb-2d04-4d0c-ba02-611d87f35e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:45.210936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1094fb-2d04-4d0c-ba02-611d87f35e04 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:45.211600 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1094fb-2d04-4d0c-ba02-611d87f35e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:45.216169 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1094fb-2d04-4d0c-ba02-611d87f35e04 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:45.246634 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1437/2894] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:32:45 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:45.250827 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f53ada-f3bb-4183-bab8-23fe70fc816d admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:45.262006 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f53ada-f3bb-4183-bab8-23fe70fc816d admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:45.267504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f3c5a-1413-43cf-b3f9-878cfe3f0d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:45.268159 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f3c5a-1413-43cf-b3f9-878cfe3f0d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:45.268624 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f3c5a-1413-43cf-b3f9-878cfe3f0d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:45.268978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f3c5a-1413-43cf-b3f9-878cfe3f0d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:45.269701 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f3c5a-1413-43cf-b3f9-878cfe3f0d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:45.271470 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f3c5a-1413-43cf-b3f9-878cfe3f0d33 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:45.282705 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1458/2895] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:45.286966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1094fb-2d04-4d0c-ba02-611d87f35e04 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:45.297301 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1094fb-2d04-4d0c-ba02-611d87f35e04 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:45.302124 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f123fcb-e414-44a2-8ba5-8403d06cf0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:45.302826 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f123fcb-e414-44a2-8ba5-8403d06cf0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:45.303132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f123fcb-e414-44a2-8ba5-8403d06cf0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:45.303454 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f123fcb-e414-44a2-8ba5-8403d06cf0d2 admin admin] PATH_INFO: `/v3/projects/3201f470344d496ba9fa5cb184532c61/users/53203ac5c6cd4b43b2cd2b4bd30fdf0c/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:45.319446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f123fcb-e414-44a2-8ba5-8403d06cf0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3201f470344d496ba9fa5cb184532c61, user_id=53203ac5c6cd4b43b2cd2b4bd30fdf0c, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:45.322069 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f123fcb-e414-44a2-8ba5-8403d06cf0d2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:45.337846 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1438/2896] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:45 2022] PUT /identity/v3/projects/3201f470344d496ba9fa5cb184532c61/users/53203ac5c6cd4b43b2cd2b4bd30fdf0c/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:45.341976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f3c5a-1413-43cf-b3f9-878cfe3f0d33 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:45.353738 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f3c5a-1413-43cf-b3f9-878cfe3f0d33 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:45.418377 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5aca31-c412-493d-a467-deb137359b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:45.419199 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5aca31-c412-493d-a467-deb137359b2e admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:45.419941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5aca31-c412-493d-a467-deb137359b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:45.419941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5aca31-c412-493d-a467-deb137359b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:45.420732 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5aca31-c412-493d-a467-deb137359b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:45.422616 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5aca31-c412-493d-a467-deb137359b2e admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:45.435816 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1459/2897] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 01:32:45.439826 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f123fcb-e414-44a2-8ba5-8403d06cf0d2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:45.452028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f123fcb-e414-44a2-8ba5-8403d06cf0d2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:45.457782 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae94ca-57a4-49cc-aecd-1153b5cced7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:45.458645 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae94ca-57a4-49cc-aecd-1153b5cced7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:45.459018 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae94ca-57a4-49cc-aecd-1153b5cced7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:45.459423 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae94ca-57a4-49cc-aecd-1153b5cced7d admin admin] PATH_INFO: `/v3/projects/3201f470344d496ba9fa5cb184532c61/users/53203ac5c6cd4b43b2cd2b4bd30fdf0c/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:45.461854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae94ca-57a4-49cc-aecd-1153b5cced7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3201f470344d496ba9fa5cb184532c61, user_id=53203ac5c6cd4b43b2cd2b4bd30fdf0c, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:45.464671 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae94ca-57a4-49cc-aecd-1153b5cced7d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:45.476999 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1439/2898] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:45 2022] PUT /identity/v3/projects/3201f470344d496ba9fa5cb184532c61/users/53203ac5c6cd4b43b2cd2b4bd30fdf0c/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:45.488457 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0cb8-e795-48c7-9224-b7cc2705bff7 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:45.488814 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0cb8-e795-48c7-9224-b7cc2705bff7 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:45.489019 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0cb8-e795-48c7-9224-b7cc2705bff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:45.522185 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-4ecd0cb8-e795-48c7-9224-b7cc2705bff7 None None] MFA Rules not processed for user `53203ac5c6cd4b43b2cd2b4bd30fdf0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:45.523485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4ecd0cb8-e795-48c7-9224-b7cc2705bff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:45.571870 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:45.605808 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1460/2899] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:45.618291 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae94ca-57a4-49cc-aecd-1153b5cced7d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:45.620107 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4fae94ca-57a4-49cc-aecd-1153b5cced7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:45.686033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae94ca-57a4-49cc-aecd-1153b5cced7d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:45.689739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3db7cd-1e95-4bc8-950c-8d6e0ab74351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:45.690353 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db7cd-1e95-4bc8-950c-8d6e0ab74351 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:45.690627 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db7cd-1e95-4bc8-950c-8d6e0ab74351 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:45.690919 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db7cd-1e95-4bc8-950c-8d6e0ab74351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:45.702863 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3db7cd-1e95-4bc8-950c-8d6e0ab74351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:45.704311 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3db7cd-1e95-4bc8-950c-8d6e0ab74351 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:45.714151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1440/2900] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:32:45.761038 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd0cb8-e795-48c7-9224-b7cc2705bff7 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:45.763084 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-4ecd0cb8-e795-48c7-9224-b7cc2705bff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:45.779730 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd0cb8-e795-48c7-9224-b7cc2705bff7 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:45.783720 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c2431-a579-4864-81fe-0e089584cb73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:45.784352 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c2431-a579-4864-81fe-0e089584cb73 service cinder] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:45.784630 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c2431-a579-4864-81fe-0e089584cb73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:45.784899 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c2431-a579-4864-81fe-0e089584cb73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:45.843565 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c2431-a579-4864-81fe-0e089584cb73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:45.845121 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c2431-a579-4864-81fe-0e089584cb73 service cinder] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:45.855428 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1461/2901] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:49.400262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3db7cd-1e95-4bc8-950c-8d6e0ab74351 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:49.467175 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3db7cd-1e95-4bc8-950c-8d6e0ab74351 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:49.472027 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:49.472659 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:49.472941 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:49.473212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] PATH_INFO: `/v3/users/cc3963c9a35047f08a69dd418c9b6ca4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:49.474334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3963c9a35047f08a69dd418c9b6ca4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:49.476288 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:49.477892 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:49.527115 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3963c9a35047f08a69dd418c9b6ca4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:49.541710 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3963c9a35047f08a69dd418c9b6ca4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:49.549405 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3963c9a35047f08a69dd418c9b6ca4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:49.550213 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3963c9a35047f08a69dd418c9b6ca4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:49.550854 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3963c9a35047f08a69dd418c9b6ca4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:49.565798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1441/2902] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:32:49 2022] DELETE /identity/v3/users/cc3963c9a35047f08a69dd418c9b6ca4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:49.570547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af08a4-85ee-4919-bc93-47517d932b48 None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:49.571029 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af08a4-85ee-4919-bc93-47517d932b48 None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:49.571137 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af08a4-85ee-4919-bc93-47517d932b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:49.592909 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f1af08a4-85ee-4919-bc93-47517d932b48 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:49.594142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f1af08a4-85ee-4919-bc93-47517d932b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:49.656980 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1462/2903] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:49.667650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:49.669616 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:49.744151 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27599ef-23ed-4226-9dcd-de00ec21bef3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:49.748324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad000341-d3dd-4827-8d71-229c0d100eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:49.748960 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad000341-d3dd-4827-8d71-229c0d100eab service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:49.749241 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad000341-d3dd-4827-8d71-229c0d100eab service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:49.749513 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad000341-d3dd-4827-8d71-229c0d100eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:49.759401 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad000341-d3dd-4827-8d71-229c0d100eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:49.760886 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad000341-d3dd-4827-8d71-229c0d100eab service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:49.771734 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1442/2904] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:50.197041 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af08a4-85ee-4919-bc93-47517d932b48 None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:50.198558 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f1af08a4-85ee-4919-bc93-47517d932b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:50.211796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af08a4-85ee-4919-bc93-47517d932b48 None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:50.218229 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:50.218902 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:50.219162 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:50.219513 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] PATH_INFO: `/v3/projects/0d76e41f825d449099d78e56daed2bf0` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:50.221376 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d76e41f825d449099d78e56daed2bf0)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:50.223420 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:50.307329 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d76e41f825d449099d78e56daed2bf0', 'request_id': 'req-2dacb4ff-76ca-41ab-b899-351261f933d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:50.318941 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d76e41f825d449099d78e56daed2bf0', 'request_id': 'req-2dacb4ff-76ca-41ab-b899-351261f933d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:50.330394 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d76e41f825d449099d78e56daed2bf0', 'request_id': 'req-2dacb4ff-76ca-41ab-b899-351261f933d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:50.345928 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] The token cache is being invalidate because project 0d76e41f825d449099d78e56daed2bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:32:50.346245 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:50.346918 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:50.348768 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1463/2905] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:32:50 2022] DELETE /identity/v3/projects/0d76e41f825d449099d78e56daed2bf0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:50.352623 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad000341-d3dd-4827-8d71-229c0d100eab service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:50.363940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad000341-d3dd-4827-8d71-229c0d100eab service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:50.465410 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:50.465966 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:50.466272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:50.466680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] PATH_INFO: `/v3/users/53203ac5c6cd4b43b2cd2b4bd30fdf0c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:50.468335 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=53203ac5c6cd4b43b2cd2b4bd30fdf0c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:50.470365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:50.501157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:50.544962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53203ac5c6cd4b43b2cd2b4bd30fdf0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:50.568293 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53203ac5c6cd4b43b2cd2b4bd30fdf0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:50.577641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53203ac5c6cd4b43b2cd2b4bd30fdf0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:50.578548 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53203ac5c6cd4b43b2cd2b4bd30fdf0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:50.579170 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f8ad655-fd1e-42d2-9983-096dafcb52fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53203ac5c6cd4b43b2cd2b4bd30fdf0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:50.595351 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1443/2906] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:32:50 2022] DELETE /identity/v3/users/53203ac5c6cd4b43b2cd2b4bd30fdf0c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:50.877077 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:50.879473 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:50.897724 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:50.909740 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb4ff-76ca-41ab-b899-351261f933d8 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:50.968815 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:50.969459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:50.969791 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:50.970050 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] PATH_INFO: `/v3/projects/3201f470344d496ba9fa5cb184532c61` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:50.971499 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3201f470344d496ba9fa5cb184532c61)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:50.973411 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:51.026915 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3201f470344d496ba9fa5cb184532c61', 'request_id': 'req-cdf5a66e-844b-407e-8293-10c5a91d5d99'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:51.037707 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3201f470344d496ba9fa5cb184532c61', 'request_id': 'req-cdf5a66e-844b-407e-8293-10c5a91d5d99'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:51.044787 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3201f470344d496ba9fa5cb184532c61', 'request_id': 'req-cdf5a66e-844b-407e-8293-10c5a91d5d99'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:51.056592 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] The token cache is being invalidate because project 3201f470344d496ba9fa5cb184532c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:32:51.056883 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:51.057574 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-cdf5a66e-844b-407e-8293-10c5a91d5d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:51.059094 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1464/2907] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:32:50 2022] DELETE /identity/v3/projects/3201f470344d496ba9fa5cb184532c61 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:51.064143 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cd80b-ae7a-4f75-9e39-f4e35c93a097 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:51.064617 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cd80b-ae7a-4f75-9e39-f4e35c93a097 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:51.065005 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cd80b-ae7a-4f75-9e39-f4e35c93a097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:51.086696 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-171cd80b-ae7a-4f75-9e39-f4e35c93a097 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:51.087953 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-171cd80b-ae7a-4f75-9e39-f4e35c93a097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:51.152088 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1444/2908] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:51.160144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225ac8-9e2f-4e2f-a7ac-48f2892b145c None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:51.160430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225ac8-9e2f-4e2f-a7ac-48f2892b145c None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:51.160706 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225ac8-9e2f-4e2f-a7ac-48f2892b145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:51.189589 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-2c225ac8-9e2f-4e2f-a7ac-48f2892b145c None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:51.194597 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-2c225ac8-9e2f-4e2f-a7ac-48f2892b145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:51.208092 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1465/2909] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:51.212456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cd80b-ae7a-4f75-9e39-f4e35c93a097 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:51.222850 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cd80b-ae7a-4f75-9e39-f4e35c93a097 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:51.228159 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fd8d2-0925-496a-80df-4f5257fb6890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:51.228631 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fd8d2-0925-496a-80df-4f5257fb6890 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:51.228910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fd8d2-0925-496a-80df-4f5257fb6890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:51.229183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fd8d2-0925-496a-80df-4f5257fb6890 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:51.230537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fd8d2-0925-496a-80df-4f5257fb6890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 01:32:51.230936 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fd8d2-0925-496a-80df-4f5257fb6890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:51.232739 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fd8d2-0925-496a-80df-4f5257fb6890 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:51.247300 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1445/2910] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Sep 3 01:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 01:32:51.252059 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225ac8-9e2f-4e2f-a7ac-48f2892b145c None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:51.262504 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225ac8-9e2f-4e2f-a7ac-48f2892b145c None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:51.267934 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed258e-2a01-4a5c-a3bd-2ffc2767d7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:51.268612 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed258e-2a01-4a5c-a3bd-2ffc2767d7ed admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:51.269054 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed258e-2a01-4a5c-a3bd-2ffc2767d7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:51.269335 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed258e-2a01-4a5c-a3bd-2ffc2767d7ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:51.269977 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed258e-2a01-4a5c-a3bd-2ffc2767d7ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:51.272756 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed258e-2a01-4a5c-a3bd-2ffc2767d7ed admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:51.312243 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1466/2911] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:32:51 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 01:32:51.316053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fd8d2-0925-496a-80df-4f5257fb6890 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:51.326298 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fd8d2-0925-496a-80df-4f5257fb6890 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:51.385008 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a3de3-d3b6-4dc6-9e9f-0d54bdc4064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:51.385618 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3de3-d3b6-4dc6-9e9f-0d54bdc4064c admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:51.385983 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3de3-d3b6-4dc6-9e9f-0d54bdc4064c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:51.386242 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3de3-d3b6-4dc6-9e9f-0d54bdc4064c admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:51.386890 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a3de3-d3b6-4dc6-9e9f-0d54bdc4064c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:51.390181 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a3de3-d3b6-4dc6-9e9f-0d54bdc4064c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:51.411888 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1446/2912] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:32:51 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:51.416141 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed258e-2a01-4a5c-a3bd-2ffc2767d7ed admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:51.428011 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed258e-2a01-4a5c-a3bd-2ffc2767d7ed admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:51.432729 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f668-b0e2-44d9-a694-0d14a4977a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:51.433405 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f668-b0e2-44d9-a694-0d14a4977a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:51.433857 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f668-b0e2-44d9-a694-0d14a4977a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:51.434194 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f668-b0e2-44d9-a694-0d14a4977a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:51.434974 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77f668-b0e2-44d9-a694-0d14a4977a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:51.437334 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77f668-b0e2-44d9-a694-0d14a4977a37 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:51.451665 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1467/2913] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:51.456796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a3de3-d3b6-4dc6-9e9f-0d54bdc4064c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:51.469176 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a3de3-d3b6-4dc6-9e9f-0d54bdc4064c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:51.474219 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c2a4-af37-46e6-858c-2cafd555c903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:51.474912 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c2a4-af37-46e6-858c-2cafd555c903 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:51.475371 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c2a4-af37-46e6-858c-2cafd555c903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:51.475640 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c2a4-af37-46e6-858c-2cafd555c903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:51.476336 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454c2a4-af37-46e6-858c-2cafd555c903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:51.477965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454c2a4-af37-46e6-858c-2cafd555c903 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:51.489962 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1447/2914] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:51.495112 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f668-b0e2-44d9-a694-0d14a4977a37 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:51.513222 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f668-b0e2-44d9-a694-0d14a4977a37 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:51.522362 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521dd81-14eb-4547-b23c-48ca939201e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:51.523113 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521dd81-14eb-4547-b23c-48ca939201e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:51.523515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521dd81-14eb-4547-b23c-48ca939201e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:51.523838 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521dd81-14eb-4547-b23c-48ca939201e9 admin admin] PATH_INFO: `/v3/projects/fadd420c617e48acb77e5341f6ef3284/users/160569d2bfc94ceba6679bacbb3907f6/roles/b6a39390284c4cef8e11ad0888016b38` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:51.541803 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521dd81-14eb-4547-b23c-48ca939201e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fadd420c617e48acb77e5341f6ef3284, user_id=160569d2bfc94ceba6679bacbb3907f6, role_id=b6a39390284c4cef8e11ad0888016b38)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:51.545348 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521dd81-14eb-4547-b23c-48ca939201e9 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:51.564258 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1468/2915] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:51 2022] PUT /identity/v3/projects/fadd420c617e48acb77e5341f6ef3284/users/160569d2bfc94ceba6679bacbb3907f6/roles/b6a39390284c4cef8e11ad0888016b38 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:51.569275 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff99bd-fbbe-4648-91ce-11cbe661a885 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:51.569555 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff99bd-fbbe-4648-91ce-11cbe661a885 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:51.569848 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff99bd-fbbe-4648-91ce-11cbe661a885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:51.584427 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:51.591232 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9eff99bd-fbbe-4648-91ce-11cbe661a885 None None] MFA Rules not processed for user `f6ea32dae1644e03acb20487dc4a95a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:51.593116 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9eff99bd-fbbe-4648-91ce-11cbe661a885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:51.667609 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1448/2916] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:51.677485 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521dd81-14eb-4547-b23c-48ca939201e9 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:51.679422 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e521dd81-14eb-4547-b23c-48ca939201e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:51.712960 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:51.742802 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521dd81-14eb-4547-b23c-48ca939201e9 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:51.746521 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d00057-74ba-4138-af5c-07da3f73f811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:51.747123 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d00057-74ba-4138-af5c-07da3f73f811 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:51.747568 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d00057-74ba-4138-af5c-07da3f73f811 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:51.747959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d00057-74ba-4138-af5c-07da3f73f811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:51.766015 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d00057-74ba-4138-af5c-07da3f73f811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:51.767495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d00057-74ba-4138-af5c-07da3f73f811 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:51.778380 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1469/2917] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:52.460021 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce14b7-76f1-4cad-8427-e32d20226635 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:52.460341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce14b7-76f1-4cad-8427-e32d20226635 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:52.460614 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce14b7-76f1-4cad-8427-e32d20226635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:52.495773 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-64ce14b7-76f1-4cad-8427-e32d20226635 None None] MFA Rules not processed for user `160569d2bfc94ceba6679bacbb3907f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:52.497477 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-64ce14b7-76f1-4cad-8427-e32d20226635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:52.583341 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1449/2918] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:52.584836 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d00057-74ba-4138-af5c-07da3f73f811 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:52.596283 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d00057-74ba-4138-af5c-07da3f73f811 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:52.602777 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef70119-b267-4441-82b5-dafa2199a92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:52.603451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70119-b267-4441-82b5-dafa2199a92b admin admin] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:52.603737 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70119-b267-4441-82b5-dafa2199a92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:52.604044 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70119-b267-4441-82b5-dafa2199a92b admin admin] PATH_INFO: `/v3/projects` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:52.604992 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef70119-b267-4441-82b5-dafa2199a92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:52.606822 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef70119-b267-4441-82b5-dafa2199a92b admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:52.641437 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1470/2919] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Sep 3 01:32:52 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:52.645564 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce14b7-76f1-4cad-8427-e32d20226635 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:52.660524 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce14b7-76f1-4cad-8427-e32d20226635 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:52.738855 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefed5e-65ba-407f-8e37-f914b63899f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:52.740053 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefed5e-65ba-407f-8e37-f914b63899f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:52.740339 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefed5e-65ba-407f-8e37-f914b63899f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:52.740613 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefed5e-65ba-407f-8e37-f914b63899f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:52.741257 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefed5e-65ba-407f-8e37-f914b63899f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:52.743727 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefed5e-65ba-407f-8e37-f914b63899f8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:52.776532 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1450/2920] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Sep 3 01:32:52 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 01:32:52.777907 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef70119-b267-4441-82b5-dafa2199a92b admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:52.796668 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef70119-b267-4441-82b5-dafa2199a92b admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:52.806965 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff71b-ce2a-4450-8bcf-04e626447ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:52.807675 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff71b-ce2a-4450-8bcf-04e626447ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:52.807959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff71b-ce2a-4450-8bcf-04e626447ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:52.808242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff71b-ce2a-4450-8bcf-04e626447ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:52.818976 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ff71b-ce2a-4450-8bcf-04e626447ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:52.821788 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ff71b-ce2a-4450-8bcf-04e626447ffe admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:52.840107 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1471/2921] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:52.841940 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefed5e-65ba-407f-8e37-f914b63899f8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:52.854323 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefed5e-65ba-407f-8e37-f914b63899f8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:52.859889 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274514cf-7a94-4c7e-a97c-b7b32ed71add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:52.860667 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274514cf-7a94-4c7e-a97c-b7b32ed71add admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:52.861010 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274514cf-7a94-4c7e-a97c-b7b32ed71add admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:52.861945 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274514cf-7a94-4c7e-a97c-b7b32ed71add admin admin] PATH_INFO: `/v3/projects/24dc80e253f848a8a638ef02b4f56610/users/97b8b6447ada4b818e76808b413b7be3/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:52.881201 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274514cf-7a94-4c7e-a97c-b7b32ed71add admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dc80e253f848a8a638ef02b4f56610, user_id=97b8b6447ada4b818e76808b413b7be3, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:52.884149 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274514cf-7a94-4c7e-a97c-b7b32ed71add admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:52.903856 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1451/2922] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:52 2022] PUT /identity/v3/projects/24dc80e253f848a8a638ef02b4f56610/users/97b8b6447ada4b818e76808b413b7be3/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:32:52.907942 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff71b-ce2a-4450-8bcf-04e626447ffe admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:52.918868 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff71b-ce2a-4450-8bcf-04e626447ffe admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:52.977190 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03074d7a-b891-4770-a632-15da27457f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:52.977807 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03074d7a-b891-4770-a632-15da27457f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:52.978082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03074d7a-b891-4770-a632-15da27457f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:52.978356 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03074d7a-b891-4770-a632-15da27457f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:52.979007 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03074d7a-b891-4770-a632-15da27457f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:52.980897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03074d7a-b891-4770-a632-15da27457f42 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:52.991813 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1472/2923] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Sep 3 01:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 01:32:52.996189 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274514cf-7a94-4c7e-a97c-b7b32ed71add admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:53.003051 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:53.009354 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274514cf-7a94-4c7e-a97c-b7b32ed71add admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:53.015157 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3411c-e3bf-46b1-987e-bb4c0f878e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:53.015965 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3411c-e3bf-46b1-987e-bb4c0f878e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:53.016308 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3411c-e3bf-46b1-987e-bb4c0f878e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:53.016650 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3411c-e3bf-46b1-987e-bb4c0f878e77 admin admin] PATH_INFO: `/v3/projects/24dc80e253f848a8a638ef02b4f56610/users/97b8b6447ada4b818e76808b413b7be3/roles/2e5b46d9b7824920afcbf5bdd34f3092` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:53.018830 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3411c-e3bf-46b1-987e-bb4c0f878e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dc80e253f848a8a638ef02b4f56610, user_id=97b8b6447ada4b818e76808b413b7be3, role_id=2e5b46d9b7824920afcbf5bdd34f3092)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:53.021655 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3411c-e3bf-46b1-987e-bb4c0f878e77 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:53.032810 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1452/2924] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Sep 3 01:32:52 2022] PUT /identity/v3/projects/24dc80e253f848a8a638ef02b4f56610/users/97b8b6447ada4b818e76808b413b7be3/roles/2e5b46d9b7824920afcbf5bdd34f3092 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:53.894507 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03074d7a-b891-4770-a632-15da27457f42 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:53.896579 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-03074d7a-b891-4770-a632-15da27457f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:54.014880 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3411c-e3bf-46b1-987e-bb4c0f878e77 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:54.017028 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-81f3411c-e3bf-46b1-987e-bb4c0f878e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:54.073671 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03074d7a-b891-4770-a632-15da27457f42 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:54.116043 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:54.143183 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3411c-e3bf-46b1-987e-bb4c0f878e77 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:54.147396 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015112c-19ee-499a-851f-3725279d899b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:54.147959 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015112c-19ee-499a-851f-3725279d899b service placement] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:54.148234 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015112c-19ee-499a-851f-3725279d899b service placement] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:54.148503 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015112c-19ee-499a-851f-3725279d899b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:54.150249 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-c015112c-19ee-499a-851f-3725279d899b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:54.154852 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:54.155588 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:54.155932 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:54.156803 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] PATH_INFO: `/v3/users/0be8fd9b6af047e0af47844f642c6dc2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:54.157459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be8fd9b6af047e0af47844f642c6dc2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:54.159456 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:54.162812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015112c-19ee-499a-851f-3725279d899b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:54.164475 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015112c-19ee-499a-851f-3725279d899b service placement] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:54.180205 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1473/2925] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:54.183571 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728f90d-d9ec-42bf-a3f9-2552bd40967f None None] REQUEST_METHOD: `POST` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:54.183947 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728f90d-d9ec-42bf-a3f9-2552bd40967f None None] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:54.184289 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728f90d-d9ec-42bf-a3f9-2552bd40967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:54.224649 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.auth.core [None req-f728f90d-d9ec-42bf-a3f9-2552bd40967f None None] MFA Rules not processed for user `97b8b6447ada4b818e76808b413b7be3`. Rule list: `[]` (Enabled: `True`). {{(pid=81480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:54.225876 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f728f90d-d9ec-42bf-a3f9-2552bd40967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:54.258326 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be8fd9b6af047e0af47844f642c6dc2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.271668 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be8fd9b6af047e0af47844f642c6dc2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.279283 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be8fd9b6af047e0af47844f642c6dc2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.280109 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be8fd9b6af047e0af47844f642c6dc2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.280756 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-422de7de-5779-4edc-af93-277e0daa07b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be8fd9b6af047e0af47844f642c6dc2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.296195 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1453/2926] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:32:54 2022] DELETE /identity/v3/users/0be8fd9b6af047e0af47844f642c6dc2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:54.301989 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1474/2927] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:54.313438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b62ad-fd5f-4b01-9146-b2b9d0621a6e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:54.313829 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b62ad-fd5f-4b01-9146-b2b9d0621a6e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:54.314103 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b62ad-fd5f-4b01-9146-b2b9d0621a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:54.334697 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-696b62ad-fd5f-4b01-9146-b2b9d0621a6e None None] MFA Rules not processed for user `160569d2bfc94ceba6679bacbb3907f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 01:32:54.336023 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-696b62ad-fd5f-4b01-9146-b2b9d0621a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:54.391100 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1454/2928] 10.222.0.39 () {58 vars in 958 bytes} [Sat Sep 3 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 01:32:54.402142 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728f90d-d9ec-42bf-a3f9-2552bd40967f None None] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:54.403818 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f728f90d-d9ec-42bf-a3f9-2552bd40967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:54.486438 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b62ad-fd5f-4b01-9146-b2b9d0621a6e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:54.486587 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728f90d-d9ec-42bf-a3f9-2552bd40967f None None] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:54.487980 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-696b62ad-fd5f-4b01-9146-b2b9d0621a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:54.503875 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:54.541346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=100 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:54.559964 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0826a9-46ac-4108-92c2-f98d70858534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:54.560812 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0826a9-46ac-4108-92c2-f98d70858534 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:54.561186 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0826a9-46ac-4108-92c2-f98d70858534 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:54.561522 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0826a9-46ac-4108-92c2-f98d70858534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:54.563994 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5a0826a9-46ac-4108-92c2-f98d70858534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:54.566843 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b62ad-fd5f-4b01-9146-b2b9d0621a6e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:54.571446 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:54.572065 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:54.572346 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:54.572626 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] PATH_INFO: `/v3/projects/c2eeec7f0cfe44ba89d1af0a6c5620be` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:54.573800 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2eeec7f0cfe44ba89d1af0a6c5620be)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:54.574661 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0826a9-46ac-4108-92c2-f98d70858534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:54.575802 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:54.576312 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0826a9-46ac-4108-92c2-f98d70858534 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:54.586013 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1475/2929] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:54.625154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2eeec7f0cfe44ba89d1af0a6c5620be', 'request_id': 'req-ac3119a0-12ac-439f-a1ca-98d2515072d2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.633910 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2eeec7f0cfe44ba89d1af0a6c5620be', 'request_id': 'req-ac3119a0-12ac-439f-a1ca-98d2515072d2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.641133 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2eeec7f0cfe44ba89d1af0a6c5620be', 'request_id': 'req-ac3119a0-12ac-439f-a1ca-98d2515072d2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.652174 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] The token cache is being invalidate because project c2eeec7f0cfe44ba89d1af0a6c5620be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:32:54.652466 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.653136 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.654729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1455/2930] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:32:54 2022] DELETE /identity/v3/projects/c2eeec7f0cfe44ba89d1af0a6c5620be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 01:32:54.658683 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0826a9-46ac-4108-92c2-f98d70858534 service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:54.669547 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0826a9-46ac-4108-92c2-f98d70858534 service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:54.728242 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:54.728873 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:54.729151 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:54.729421 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] PATH_INFO: `/v3/users/84a7aed1e4c04f43af1d6f1759cdb48a` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:54.730545 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a7aed1e4c04f43af1d6f1759cdb48a)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:54.732691 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:54.782430 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a7aed1e4c04f43af1d6f1759cdb48a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.794880 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a7aed1e4c04f43af1d6f1759cdb48a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.802291 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a7aed1e4c04f43af1d6f1759cdb48a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.803082 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a7aed1e4c04f43af1d6f1759cdb48a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.803820 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a7aed1e4c04f43af1d6f1759cdb48a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:54.817785 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1476/2931] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:32:54 2022] DELETE /identity/v3/users/84a7aed1e4c04f43af1d6f1759cdb48a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:54.825796 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:54.827520 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:54.887030 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3119a0-12ac-439f-a1ca-98d2515072d2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:54.937439 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e403fd8-1ea2-4ea1-9159-c2c7323c29c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:54.938060 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403fd8-1ea2-4ea1-9159-c2c7323c29c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:54.938334 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403fd8-1ea2-4ea1-9159-c2c7323c29c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:54.938603 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403fd8-1ea2-4ea1-9159-c2c7323c29c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:54.940485 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4e403fd8-1ea2-4ea1-9159-c2c7323c29c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:54.950182 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e403fd8-1ea2-4ea1-9159-c2c7323c29c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:54.951701 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e403fd8-1ea2-4ea1-9159-c2c7323c29c9 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:54.960604 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1456/2932] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 01:32:54.993560 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:54.995102 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:55.057952 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:55.064693 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01181e-fc68-4cc8-9d51-157af78c218c admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:55.070496 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:55.071128 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:55.071445 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:55.071715 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] PATH_INFO: `/v3/projects/ae9e2aa4bcdd44d9b4dd89423b64c7b1` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:55.072850 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9e2aa4bcdd44d9b4dd89423b64c7b1)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:55.074750 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:55.124330 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9e2aa4bcdd44d9b4dd89423b64c7b1', 'request_id': 'req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:55.132266 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9e2aa4bcdd44d9b4dd89423b64c7b1', 'request_id': 'req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:55.138828 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9e2aa4bcdd44d9b4dd89423b64c7b1', 'request_id': 'req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:55.149462 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] The token cache is being invalidate because project ae9e2aa4bcdd44d9b4dd89423b64c7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:32:55.149748 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:55.150385 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:32:55.151990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1477/2933] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:32:54 2022] DELETE /identity/v3/projects/ae9e2aa4bcdd44d9b4dd89423b64c7b1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:32:55.344693 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e403fd8-1ea2-4ea1-9159-c2c7323c29c9 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:55.347083 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4e403fd8-1ea2-4ea1-9159-c2c7323c29c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:55.352885 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:55.426037 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e403fd8-1ea2-4ea1-9159-c2c7323c29c9 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:55.491154 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c05822-a4b5-4808-8ee5-ac6c12cd12f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:55.491789 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c05822-a4b5-4808-8ee5-ac6c12cd12f4 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:55.492064 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c05822-a4b5-4808-8ee5-ac6c12cd12f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:55.492333 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c05822-a4b5-4808-8ee5-ac6c12cd12f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:55.494212 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d8c05822-a4b5-4808-8ee5-ac6c12cd12f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:55.505723 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c05822-a4b5-4808-8ee5-ac6c12cd12f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:55.507281 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c05822-a4b5-4808-8ee5-ac6c12cd12f4 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:55.517544 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1457/2934] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:32:57.214426 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:32:57.216610 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:57.283235 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c24442-11c0-4cf1-bc13-9eacf7e6e74a admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:32:57.287575 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05fdf8-376a-4f5a-8579-0e5816715dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bec5c8c626c40ef9906783916c49dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:32:57.288175 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05fdf8-376a-4f5a-8579-0e5816715dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:32:57.288451 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05fdf8-376a-4f5a-8579-0e5816715dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:32:57.288716 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05fdf8-376a-4f5a-8579-0e5816715dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:32:57.290644 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5d05fdf8-376a-4f5a-8579-0e5816715dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:32:57.301081 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05fdf8-376a-4f5a-8579-0e5816715dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:32:57.302611 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05fdf8-376a-4f5a-8579-0e5816715dc1 service neutron] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:32:57.311805 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1478/2935] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:33:05.513033 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=57 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:06.566732 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c05822-a4b5-4808-8ee5-ac6c12cd12f4 service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:33:06.568486 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d8c05822-a4b5-4808-8ee5-ac6c12cd12f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:33:06.628445 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c05822-a4b5-4808-8ee5-ac6c12cd12f4 service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:33:06.632663 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8772a-758b-477c-9c50-3afdbb77ea00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ccaa14fce4726826a16c4d3e6ca54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:33:06.633262 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8772a-758b-477c-9c50-3afdbb77ea00 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:33:06.633537 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8772a-758b-477c-9c50-3afdbb77ea00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:33:06.633807 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8772a-758b-477c-9c50-3afdbb77ea00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:33:06.635680 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5fb8772a-758b-477c-9c50-3afdbb77ea00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:33:06.701132 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8772a-758b-477c-9c50-3afdbb77ea00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:33:06.702471 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8772a-758b-477c-9c50-3afdbb77ea00 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:33:06.712869 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1458/2936] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:33:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:33:07.307281 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:09.152144 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05fdf8-376a-4f5a-8579-0e5816715dc1 service neutron] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:33:09.153978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-5d05fdf8-376a-4f5a-8579-0e5816715dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:33:09.234149 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05fdf8-376a-4f5a-8579-0e5816715dc1 service neutron] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:33:09.240346 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d96e90-ed7a-4ce5-9610-8fae4d941650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4076fd5abc4b508a0215ce22af85d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:33:09.240963 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d96e90-ed7a-4ce5-9610-8fae4d941650 service nova] REQUEST_METHOD: `GET` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:33:09.241241 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d96e90-ed7a-4ce5-9610-8fae4d941650 service nova] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:33:09.241515 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d96e90-ed7a-4ce5-9610-8fae4d941650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:33:09.243279 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-f1d96e90-ed7a-4ce5-9610-8fae4d941650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:33:09.256010 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d96e90-ed7a-4ce5-9610-8fae4d941650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:33:09.257638 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d96e90-ed7a-4ce5-9610-8fae4d941650 service nova] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:33:09.269314 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1479/2937] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:33:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:33:16.708247 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=50 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:19.264260 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=34 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:25.710164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8772a-758b-477c-9c50-3afdbb77ea00 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:33:25.711705 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5fb8772a-758b-477c-9c50-3afdbb77ea00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:33:25.779164 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8772a-758b-477c-9c50-3afdbb77ea00 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:33:25.784188 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:33:25.784812 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:33:25.785092 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:33:25.785362 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] PATH_INFO: `/v3/users/160569d2bfc94ceba6679bacbb3907f6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:33:25.786629 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] RBAC: Authorizing `identity:delete_user(user_id=160569d2bfc94ceba6679bacbb3907f6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:33:25.788683 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:33:25.841365 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160569d2bfc94ceba6679bacbb3907f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:25.853729 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160569d2bfc94ceba6679bacbb3907f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:25.860582 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160569d2bfc94ceba6679bacbb3907f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:25.861546 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160569d2bfc94ceba6679bacbb3907f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:25.862373 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160569d2bfc94ceba6679bacbb3907f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:25.876798 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1459/2938] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:33:25 2022] DELETE /identity/v3/users/160569d2bfc94ceba6679bacbb3907f6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:33:26.067517 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d96e90-ed7a-4ce5-9610-8fae4d941650 service nova] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:33:26.079275 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d96e90-ed7a-4ce5-9610-8fae4d941650 service nova] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:33:26.137072 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585b626-997b-4668-8462-682091823481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:33:26.137698 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b626-997b-4668-8462-682091823481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:33:26.137978 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b626-997b-4668-8462-682091823481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:33:26.138247 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b626-997b-4668-8462-682091823481 admin admin] PATH_INFO: `/v3/projects/fadd420c617e48acb77e5341f6ef3284` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:33:26.139431 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585b626-997b-4668-8462-682091823481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fadd420c617e48acb77e5341f6ef3284)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:33:26.141340 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585b626-997b-4668-8462-682091823481 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:33:26.192070 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e585b626-997b-4668-8462-682091823481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fadd420c617e48acb77e5341f6ef3284', 'request_id': 'req-e585b626-997b-4668-8462-682091823481'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.201459 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e585b626-997b-4668-8462-682091823481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fadd420c617e48acb77e5341f6ef3284', 'request_id': 'req-e585b626-997b-4668-8462-682091823481'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.208990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e585b626-997b-4668-8462-682091823481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fadd420c617e48acb77e5341f6ef3284', 'request_id': 'req-e585b626-997b-4668-8462-682091823481'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.219826 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e585b626-997b-4668-8462-682091823481 admin admin] The token cache is being invalidate because project fadd420c617e48acb77e5341f6ef3284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:33:26.220339 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e585b626-997b-4668-8462-682091823481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.221297 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-e585b626-997b-4668-8462-682091823481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.222846 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1480/2939] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:33:26 2022] DELETE /identity/v3/projects/fadd420c617e48acb77e5341f6ef3284 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:33:26.226923 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:33:26.228651 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:33:26.242324 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4de10f-20a5-4d03-bdbb-da13ffb6343b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:33:26.305043 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:33:26.305673 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:33:26.305954 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:33:26.306233 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] PATH_INFO: `/v3/users/97b8b6447ada4b818e76808b413b7be3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:33:26.307459 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b8b6447ada4b818e76808b413b7be3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:33:26.309366 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:33:26.331273 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:26.361280 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b8b6447ada4b818e76808b413b7be3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.372944 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b8b6447ada4b818e76808b413b7be3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.379641 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b8b6447ada4b818e76808b413b7be3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.380376 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b8b6447ada4b818e76808b413b7be3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.381102 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b8b6447ada4b818e76808b413b7be3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.396902 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1460/2940] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Sep 3 01:33:26 2022] DELETE /identity/v3/users/97b8b6447ada4b818e76808b413b7be3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:33:26.582590 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585b626-997b-4668-8462-682091823481 admin admin] Authenticating user token {{(pid=81480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:33:26.584088 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.fernet_utils [None req-e585b626-997b-4668-8462-682091823481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:33:26.598402 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585b626-997b-4668-8462-682091823481 admin admin] Validating token access rules against request {{(pid=81480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:33:26.655796 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ea32dae1644e03acb20487dc4a95a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec3e6016635b4d4da63f35bc10e16abb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:33:26.656344 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:33:26.656623 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:33:26.656896 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] PATH_INFO: `/v3/projects/24dc80e253f848a8a638ef02b4f56610` {{(pid=81480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:33:26.658105 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24dc80e253f848a8a638ef02b4f56610)` {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:33:26.660087 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] RBAC: Authorization granted {{(pid=81480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:33:26.701495 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:26.719218 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24dc80e253f848a8a638ef02b4f56610', 'request_id': 'req-0978a7cf-f50a-4465-9bc8-87e777de14d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.728452 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24dc80e253f848a8a638ef02b4f56610', 'request_id': 'req-0978a7cf-f50a-4465-9bc8-87e777de14d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.736090 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24dc80e253f848a8a638ef02b4f56610', 'request_id': 'req-0978a7cf-f50a-4465-9bc8-87e777de14d8'} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.748990 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] The token cache is being invalidate because project 24dc80e253f848a8a638ef02b4f56610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 01:33:26.749294 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.750069 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG keystone.notifications [None req-0978a7cf-f50a-4465-9bc8-87e777de14d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 01:33:26.751897 dv-cinder-838009-7-smb devstack@keystone.service[81480]: [pid: 81480|app: 0|req: 1481/2941] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Sep 3 01:33:26 2022] DELETE /identity/v3/projects/24dc80e253f848a8a638ef02b4f56610 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 01:33:36.393202 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:36.745497 dv-cinder-838009-7-smb devstack@keystone.service[81480]: DEBUG dbcounter [-] [81480] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:46.892305 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 01:35:46.893973 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:35:46.969367 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c0f81-f5fb-4eb7-8283-1b8f4a6f5028 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 01:35:47.032387 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bea30b-eea6-4f7e-9e08-168d9286939c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac171ccd62b4c268e79a318478414ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5153adb6d588454d851b81eaf2af1971', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 01:35:47.032989 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bea30b-eea6-4f7e-9e08-168d9286939c service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 01:35:47.033272 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bea30b-eea6-4f7e-9e08-168d9286939c service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 01:35:47.033547 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bea30b-eea6-4f7e-9e08-168d9286939c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 01:35:47.035369 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-91bea30b-eea6-4f7e-9e08-168d9286939c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 01:35:47.047016 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bea30b-eea6-4f7e-9e08-168d9286939c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 01:35:47.048675 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bea30b-eea6-4f7e-9e08-168d9286939c service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 01:35:47.058722 dv-cinder-838009-7-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1461/2942] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Sep 3 01:35:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 01:35:57.054674 dv-cinder-838009-7-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=58 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}